2024-04-16T12:45:14.846 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T12:45:14.846 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_leonidus@teuthology --verbose --archive /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170 --description fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/centos_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} --name leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/orig.config.yaml 2024-04-16T12:45:14.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T12:45:14.976 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170 branch: wip-lusov-shared-log-segment description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/centos_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} email: null first_in_suite: false job_id: '7658170' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-shared-log-segment ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds debug zombie log segments: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-shared-log-segment sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f owner: scheduled_leonidus@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 2402 sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f sleep_before_teardown: 0 subset: 111/111111 suite: fs suite_branch: wip-lusov-shared-log-segment suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfAhReQBkvDER85Qt8aPzMXLGHjz5ewbRsrgVCMdqGCKXPmfvCoH3A5k9Wpy0MNCelYiVuB+XmYpqfk3E+lcB0= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPeCb8gfBXs8Y0kYyAno9Q+hoxzxmPb9dQLiTUnzBrSbC7gAX/hjVH8GhxcYhAd1wyVry9JJ28gkaqgFNCc2gj0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cephfs_shell teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_12:36:42 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-16T12:45:14.976 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa; will attempt to use it 2024-04-16T12:45:14.977 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks 2024-04-16T12:45:14.977 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T12:45:14.979 INFO:teuthology.task.internal:Checking packages... 2024-04-16T12:45:15.001 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f' 2024-04-16T12:45:15.001 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T12:45:15.001 INFO:teuthology.packaging:ref: None 2024-04-16T12:45:15.001 INFO:teuthology.packaging:tag: None 2024-04-16T12:45:15.001 INFO:teuthology.packaging:branch: wip-lusov-shared-log-segment 2024-04-16T12:45:15.001 INFO:teuthology.packaging:sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:45:15.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-shared-log-segment 2024-04-16T12:45:15.344 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2868.gc3c87ed0 2024-04-16T12:45:15.346 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T12:45:15.351 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T12:45:15.351 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T12:45:15.388 INFO:teuthology.task.internal:Saving configuration 2024-04-16T12:45:15.403 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T12:45:15.419 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T12:45:15.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:39:07.145101', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfAhReQBkvDER85Qt8aPzMXLGHjz5ewbRsrgVCMdqGCKXPmfvCoH3A5k9Wpy0MNCelYiVuB+XmYpqfk3E+lcB0='} 2024-04-16T12:45:15.471 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:39:07.143422', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPeCb8gfBXs8Y0kYyAno9Q+hoxzxmPb9dQLiTUnzBrSbC7gAX/hjVH8GhxcYhAd1wyVry9JJ28gkaqgFNCc2gj0='} 2024-04-16T12:45:15.471 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T12:45:15.477 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-16T12:45:15.477 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-16T12:45:15.478 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T12:45:15.561 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe305bc3160>, signals=[15]) 2024-04-16T12:45:15.562 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T12:45:15.568 INFO:teuthology.task.internal:Opening connections... 2024-04-16T12:45:15.569 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:45:15.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:45:15.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:45:15.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:45:15.744 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T12:45:15.749 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-04-16T12:45:15.767 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-04-16T12:45:15.768 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-16T12:45:15.821 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-04-16T12:45:15.821 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-04-16T12:45:15.821 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-04-16T12:45:15.821 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T12:45:15.822 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T12:45:15.823 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-16T12:45:15.843 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-04-16T12:45:15.861 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-04-16T12:45:15.861 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-04-16T12:45:15.918 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-04-16T12:45:15.918 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-04-16T12:45:15.918 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-04-16T12:45:15.918 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-04-16T12:45:15.918 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-04-16T12:45:15.918 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-04-16T12:45:15.918 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T12:45:15.919 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-04-16T12:45:15.919 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-04-16T12:45:15.919 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T12:45:15.919 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-04-16T12:45:15.919 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T12:45:15.919 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T12:45:15.919 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T12:45:15.919 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-04-16T12:45:15.951 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T12:45:15.959 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T12:45:15.979 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T12:45:15.979 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-04-16T12:45:15.981 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-04-16T12:45:15.997 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T12:45:16.010 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T12:45:16.010 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-04-16T12:45:16.036 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-04-16T12:45:16.230 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T12:45:16.281 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T12:45:16.294 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-16T12:45:16.295 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-16T12:45:16.295 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T12:45:16.295 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T12:45:16.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:45:16.311 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-16T12:45:16.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:45:16.312 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-04-16T12:45:16.367 INFO:teuthology.orchestra.run.smithi106.stdout:5.14.0-361.el9.x86_64 2024-04-16T12:45:16.367 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.14.0-361.el9.x86_64 2024-04-16T12:45:16.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum install -y kernel 2024-04-16T12:45:16.369 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-361.el9.x86_64 2024-04-16T12:45:16.369 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.14.0-361.el9.x86_64 2024-04-16T12:45:16.369 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-04-16T12:45:19.027 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - AppStream 6.7 MB/s | 6.7 MB 00:01 2024-04-16T12:45:19.028 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - AppStream 6.6 MB/s | 6.7 MB 00:01 2024-04-16T12:45:20.926 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - BaseOS 2.5 MB/s | 2.0 MB 00:00 2024-04-16T12:45:20.953 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2024-04-16T12:45:21.808 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T12:45:23.768 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-16T12:45:24.436 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.0 MB 00:03 2024-04-16T12:45:28.002 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.2 MB 00:00 2024-04-16T12:45:29.336 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 19 MB 00:03 2024-04-16T12:45:29.486 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 16 kB 00:00 2024-04-16T12:45:31.646 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-16T12:45:33.429 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-16T12:45:35.130 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-04-16T12:45:36.729 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-16T12:45:39.102 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T12:45:39.103 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T12:45:39.201 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-16T12:45:39.209 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-16T12:45:39.209 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-16T12:45:39.209 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout:Install 4 Packages 2024-04-16T12:45:39.210 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:45:39.211 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 77 M 2024-04-16T12:45:39.211 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 123 M 2024-04-16T12:45:39.211 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-16T12:45:39.513 INFO:teuthology.orchestra.run.smithi171.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 918 kB/s | 277 kB 00:00 2024-04-16T12:45:40.288 INFO:teuthology.orchestra.run.smithi171.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 14 MB/s | 15 MB 00:01 2024-04-16T12:45:40.972 INFO:teuthology.orchestra.run.smithi171.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 19 MB/s | 34 MB 00:01 2024-04-16T12:45:42.481 INFO:teuthology.orchestra.run.smithi171.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 9.3 MB/s | 28 MB 00:02 2024-04-16T12:45:42.483 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:45:42.484 INFO:teuthology.orchestra.run.smithi171.stdout:Total 23 MB/s | 77 MB 00:03 2024-04-16T12:45:42.484 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-16T12:45:42.862 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-16T12:45:42.862 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-16T12:45:43.680 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-16T12:45:43.681 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-16T12:45:45.988 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-16T12:45:46.579 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:45:46.666 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:49.414 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:49.551 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:54.308 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:54.417 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:59.201 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:46:09.806 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 617 kB/s | 21 MB 00:34 2024-04-16T12:46:14.786 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-16T12:46:17.101 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T12:46:17.102 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T12:46:17.220 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-04-16T12:46:17.231 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-04-16T12:46:17.231 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-04-16T12:46:17.231 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-04-16T12:46:17.231 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout:Install 4 Packages 2024-04-16T12:46:17.232 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:46:17.233 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 77 M 2024-04-16T12:46:17.233 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 123 M 2024-04-16T12:46:17.233 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-04-16T12:46:17.596 INFO:teuthology.orchestra.run.smithi106.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 765 kB/s | 277 kB 00:00 2024-04-16T12:46:18.571 INFO:teuthology.orchestra.run.smithi106.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 11 MB/s | 15 MB 00:01 2024-04-16T12:46:19.362 INFO:teuthology.orchestra.run.smithi106.stdout:(3/4): kernel-modules-core-5.14.0-438.el9.x86_6 16 MB/s | 28 MB 00:01 2024-04-16T12:46:19.929 INFO:teuthology.orchestra.run.smithi106.stdout:(4/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 12 MB/s | 34 MB 00:02 2024-04-16T12:46:19.932 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:46:19.932 INFO:teuthology.orchestra.run.smithi106.stdout:Total 28 MB/s | 77 MB 00:02 2024-04-16T12:46:19.933 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-04-16T12:46:20.291 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-04-16T12:46:20.291 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-04-16T12:46:21.179 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-04-16T12:46:21.179 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-04-16T12:46:23.482 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-04-16T12:46:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:46:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:46:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:46:27.158 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:46:28.315 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:46:28.315 INFO:teuthology.orchestra.run.smithi171.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T12:46:28.315 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:46:28.358 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:46:28.773 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:46:28.773 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:46:28.773 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:46:28.773 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:46:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:46:29.159 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-16T12:46:29.513 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:46:29.618 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:46:29.619 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:46:29.619 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T12:46:29.619 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T12:46:29.619 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T12:46:29.619 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-16T12:46:29.619 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T12:46:29.620 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:46:29.700 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:46:29.701 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:46:29.701 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-04-16T12:46:29.740 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 68.el9 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8264254 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T12:46:29.741 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:46:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T12:46:29.743 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T12:46:29.743 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 5.14.0-438.el9.x86_64 2024-04-16T12:46:29.743 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T12:46:30.368 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-04-16T12:46:31.766 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T12:46:31.801 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-04-16T12:46:31.803 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-16T12:46:31.818 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.DTsKeRZKAS 2024-04-16T12:46:31.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DTsKeRZKAS 2024-04-16T12:46:31.888 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.DTsKeRZKAS 2024-04-16T12:46:31.895 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:46:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:46:32.028 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.DTsKeRZKAS is 6KB 2024-04-16T12:46:32.076 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.DTsKeRZKAS 2024-04-16T12:46:32.090 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T12:46:32.163 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T12:46:32.163 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T12:46:32.163 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T12:46:32.163 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T12:46:32.165 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T12:46:32.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-04-16T12:46:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:47:02.318 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-16T12:47:02.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-16T12:47:02.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:47:06.077 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:47:06.077 INFO:teuthology.orchestra.run.smithi106.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T12:47:06.077 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:47:06.120 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:47:06.455 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:47:06.455 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:47:06.455 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:47:06.455 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:47:06.868 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-04-16T12:47:07.195 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:47:07.296 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:47:07.297 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:47:07.297 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T12:47:07.297 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T12:47:07.297 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T12:47:07.297 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-16T12:47:07.297 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T12:47:07.297 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:47:07.378 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:47:07.378 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:47:07.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -qi grub2-tools 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Name : grub2-tools 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Epoch : 1 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Version : 2.06 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Release : 68.el9 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: x86_64 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Group : Unspecified 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Size : 8264254 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:License : GPLv3+ 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T12:47:07.413 INFO:teuthology.orchestra.run.smithi106.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:Packager : builder@centos.org 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:Vendor : CentOS 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:Summary : Support tools for GRUB. 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:Description : 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:hardware devices. 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:47:07.414 INFO:teuthology.orchestra.run.smithi106.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T12:47:07.415 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T12:47:07.415 INFO:teuthology.task.kernel:Updating grub on smithi106 to boot 5.14.0-438.el9.x86_64 2024-04-16T12:47:07.415 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T12:47:07.999 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-04-16T12:47:09.353 INFO:teuthology.orchestra.run.smithi106.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T12:47:09.391 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-04-16T12:47:09.393 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-16T12:47:09.408 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.YiUTX1WsJ3 2024-04-16T12:47:09.408 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YiUTX1WsJ3 2024-04-16T12:47:09.477 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.YiUTX1WsJ3 2024-04-16T12:47:09.615 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.YiUTX1WsJ3 is 6KB 2024-04-16T12:47:09.664 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.YiUTX1WsJ3 2024-04-16T12:47:09.678 DEBUG:teuthology.orchestra.run.smithi106:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T12:47:09.750 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T12:47:09.750 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T12:47:09.750 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T12:47:09.751 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T12:47:09.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T12:47:09.907 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2024-04-16T12:47:36.991 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-16T12:47:39.913 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-16T12:47:39.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-16T12:47:39.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:47:45.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-16T12:47:45.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:48:04.383 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-16T12:48:16.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-16T12:48:16.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:48:16.775 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-16T12:48:17.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-16T12:48:17.233 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-438.el9.x86_64"... 2024-04-16T12:48:17.233 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-04-16T12:48:17.248 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-438.el9.x86_64 2024-04-16T12:48:17.248 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T12:48:17.248 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T12:48:17.248 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T12:48:18.249 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-16T12:48:18.249 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T12:48:18.348 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-04-16T12:48:18.389 DEBUG:teuthology.parallel:result is None 2024-04-16T12:48:39.917 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T12:48:48.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-16T12:48:48.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:48:52.265 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-16T12:48:52.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-16T12:48:52.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-438.el9.x86_64"... 2024-04-16T12:48:52.871 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-16T12:48:52.885 INFO:teuthology.orchestra.run.smithi106.stdout:5.14.0-438.el9.x86_64 2024-04-16T12:48:52.886 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T12:48:52.886 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T12:48:52.886 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T12:48:53.886 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-16T12:48:53.887 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T12:48:53.974 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-04-16T12:48:54.024 DEBUG:teuthology.parallel:result is None 2024-04-16T12:48:54.024 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T12:48:54.034 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T12:48:54.034 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T12:48:54.036 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T12:48:54.056 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T12:48:54.066 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T12:48:54.125 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T12:48:54.125 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T12:48:54.128 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T12:48:54.169 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T12:48:54.178 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T12:48:54.179 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T12:48:54.195 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T12:48:54.224 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:48:54.238 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:48:54.238 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:48:54.253 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:48:54.255 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T12:48:54.266 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T12:48:54.266 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T12:48:54.284 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T12:48:54.327 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T12:48:54.340 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T12:48:54.340 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:48:54.355 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:48:54.384 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:48:54.449 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:48:54.501 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:48:54.580 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:48:54.627 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:48:54.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T12:48:54.697 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:48:54.737 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:48:54.797 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:48:54.875 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:48:54.926 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:48:54.926 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T12:48:54.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-04-16T12:48:54.998 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-04-16T12:48:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:48:55.101 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:48:55.535 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T12:48:55.543 INFO:teuthology.task.internal:Starting timer... 2024-04-16T12:48:55.543 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T12:48:55.595 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T12:48:55.644 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-16T12:48:55.644 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2024-04-16T12:48:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2024-04-16T12:48:55.742 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-04-16T12:48:55.821 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-04-16T12:48:55.822 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T12:48:55.822 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2024-04-16T12:48:55.856 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2024-04-16T12:48:55.856 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-04-16T12:48:55.883 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-04-16T12:48:55.883 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi106.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-04-16T12:48:55.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:48:55.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:48:55.924 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:48:55.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:48:55.954 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T12:48:55.954 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2024-04-16T12:48:56.001 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-04-16T12:48:56.032 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T12:48:56.043 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T12:48:56.060 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T12:48:56.062 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T12:53:43.450 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-04-16T12:53:43.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-16T12:53:43.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:53:43.671 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-16T12:53:43.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-16T12:53:43.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-16T12:53:43.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:53:44.053 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-16T12:53:44.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-16T12:53:44.136 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T12:53:44.147 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T12:53:44.147 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T12:53:44.148 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:53:44.150 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T12:53:44.150 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:53:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T12:53:44.203 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T12:53:44.222 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T12:53:44.232 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T12:53:44.236 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2024-04-16T12:53:44.250 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2024-04-16T12:53:44.269 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T12:53:44.269 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-04-16T12:53:44.279 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-04-16T12:53:44.285 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T12:53:44.298 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T12:53:44.314 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T12:53:44.339 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:53:44.339 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:53:44.339 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-04-16T12:53:44.339 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.339 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.339 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.339 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.374 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:53:44.375 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:53:44.376 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-04-16T12:53:44.376 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.376 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.376 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.376 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:53:44.376 INFO:teuthology.run_tasks:Running task install... 2024-04-16T12:53:44.401 DEBUG:teuthology.task.install:project ceph 2024-04-16T12:53:44.401 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}} 2024-04-16T12:53:44.401 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'} 2024-04-16T12:53:44.401 INFO:teuthology.task.install:Using flavor: default 2024-04-16T12:53:44.450 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T12:53:44.450 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-16T12:53:44.450 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T12:53:44.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:53:44.453 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T12:53:44.498 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:53:44.911 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T12:53:44.911 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T12:53:44.955 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T12:53:44.955 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T12:53:45.194 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T12:53:45.194 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:53:45.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T12:53:45.227 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T12:53:45.227 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T12:53:45.318 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T12:53:45.403 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T12:53:45.474 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2024-04-16T12:53:45.475 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2024-04-16T12:53:45.486 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T12:53:45.486 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:53:45.487 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T12:53:45.548 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T12:53:45.549 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T12:53:45.626 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T12:53:45.712 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T12:53:45.726 INFO:teuthology.orchestra.run.smithi106.stdout:74 files removed 2024-04-16T12:53:45.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T12:53:45.781 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-04-16T12:53:45.783 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-04-16T12:53:46.032 INFO:teuthology.orchestra.run.smithi171.stdout:74 files removed 2024-04-16T12:53:46.061 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T12:53:46.999 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 89 kB/s | 83 kB 00:00 2024-04-16T12:53:47.558 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 71 kB/s | 83 kB 00:01 2024-04-16T12:53:47.758 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-04-16T12:53:48.192 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 20 kB/s | 11 kB 00:00 2024-04-16T12:53:48.408 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 3.1 kB/s | 1.9 kB 00:00 2024-04-16T12:53:48.927 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-04-16T12:53:48.959 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2024-04-16T12:53:49.528 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-16T12:53:51.120 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - BaseOS 1.9 MB/s | 2.0 MB 00:01 2024-04-16T12:53:51.320 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - BaseOS 2.9 MB/s | 2.0 MB 00:00 2024-04-16T12:53:51.912 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-04-16T12:53:53.168 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.0 MB 00:01 2024-04-16T12:53:56.194 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 19 MB 00:01 2024-04-16T12:53:58.786 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 19 MB 00:05 2024-04-16T12:54:00.195 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-16T12:54:01.855 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-16T12:54:02.911 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-16T12:54:03.372 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-16T12:54:04.379 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-16T12:54:08.439 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-16T12:54:08.747 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 21 MB 00:04 2024-04-16T12:54:11.171 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:54:11.171 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:54:11.182 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T12:54:11.186 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T12:54:11.186 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T12:54:11.186 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T12:54:11.186 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T12:54:11.188 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T12:54:11.189 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T12:54:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-16T12:54:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================================ 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================================ 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T12:54:11.296 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T12:54:11.297 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T12:54:11.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T12:54:11.299 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T12:54:11.300 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T12:54:11.305 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T12:54:11.305 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T12:54:11.305 INFO:teuthology.orchestra.run.smithi171.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T12:54:11.306 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T12:54:11.307 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T12:54:11.308 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T12:54:11.309 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T12:54:11.310 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T12:54:11.310 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T12:54:11.310 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T12:54:11.310 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T12:54:11.310 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T12:54:11.311 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T12:54:11.312 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T12:54:11.313 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T12:54:11.314 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T12:54:11.317 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T12:54:11.318 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-04-16T12:54:11.319 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T12:54:11.320 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:54:11.320 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-16T12:54:11.320 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================================ 2024-04-16T12:54:11.320 INFO:teuthology.orchestra.run.smithi171.stdout:Install 150 Packages 2024-04-16T12:54:11.320 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 24 Packages 2024-04-16T12:54:11.320 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:54:11.320 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 228 M 2024-04-16T12:54:11.321 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-16T12:54:12.665 INFO:teuthology.orchestra.run.smithi171.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 9.2 kB/s | 6.6 kB 00:00 2024-04-16T12:54:13.565 INFO:teuthology.orchestra.run.smithi171.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 989 kB/s | 890 kB 00:00 2024-04-16T12:54:13.698 INFO:teuthology.orchestra.run.smithi171.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 1.1 MB/s | 145 kB 00:00 2024-04-16T12:54:13.772 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-04-16T12:54:15.191 INFO:teuthology.orchestra.run.smithi171.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 1.6 MB/s | 2.4 MB 00:01 2024-04-16T12:54:16.257 INFO:teuthology.orchestra.run.smithi171.stdout:(5/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 1.4 MB/s | 1.5 MB 00:01 2024-04-16T12:54:16.500 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:54:16.501 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:54:16.513 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T12:54:16.513 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T12:54:16.514 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T12:54:16.516 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T12:54:16.517 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T12:54:16.519 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T12:54:16.520 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T12:54:16.599 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-04-16T12:54:16.631 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================================ 2024-04-16T12:54:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-04-16T12:54:16.631 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================================ 2024-04-16T12:54:16.631 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-04-16T12:54:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T12:54:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T12:54:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T12:54:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T12:54:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T12:54:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T12:54:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T12:54:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T12:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T12:54:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T12:54:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T12:54:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T12:54:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T12:54:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T12:54:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T12:54:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T12:54:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T12:54:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T12:54:16.649 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout:Installing weak dependencies: 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================================ 2024-04-16T12:54:16.650 INFO:teuthology.orchestra.run.smithi106.stdout:Install 150 Packages 2024-04-16T12:54:16.651 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 24 Packages 2024-04-16T12:54:16.651 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:54:16.651 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 228 M 2024-04-16T12:54:16.651 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-04-16T12:54:17.973 INFO:teuthology.orchestra.run.smithi106.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-16T12:54:17.990 INFO:teuthology.orchestra.run.smithi171.stdout:(6/174): ceph-common-19.0.0-2868.gc3c87ed0.el9. 3.5 MB/s | 21 MB 00:06 2024-04-16T12:54:18.166 INFO:teuthology.orchestra.run.smithi171.stdout:(7/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 883 kB/s | 5.4 MB 00:06 2024-04-16T12:54:19.340 INFO:teuthology.orchestra.run.smithi106.stdout:(2/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 2.9 MB/s | 5.4 MB 00:01 2024-04-16T12:54:19.374 INFO:teuthology.orchestra.run.smithi106.stdout:(3/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 635 kB/s | 890 kB 00:01 2024-04-16T12:54:19.416 INFO:teuthology.orchestra.run.smithi106.stdout:(4/174): ceph-immutable-object-cache-19.0.0-286 1.9 MB/s | 145 kB 00:00 2024-04-16T12:54:19.857 INFO:teuthology.orchestra.run.smithi171.stdout:(8/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 1.3 MB/s | 4.7 MB 00:03 2024-04-16T12:54:19.882 INFO:teuthology.orchestra.run.smithi106.stdout:(5/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 3.2 MB/s | 1.5 MB 00:00 2024-04-16T12:54:19.958 INFO:teuthology.orchestra.run.smithi171.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 252 kB/s | 25 kB 00:00 2024-04-16T12:54:20.841 INFO:teuthology.orchestra.run.smithi106.stdout:(6/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 4.9 MB/s | 4.7 MB 00:00 2024-04-16T12:54:21.055 INFO:teuthology.orchestra.run.smithi106.stdout:(7/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 1.4 MB/s | 2.4 MB 00:01 2024-04-16T12:54:23.819 INFO:teuthology.orchestra.run.smithi171.stdout:(10/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x8 2.9 MB/s | 17 MB 00:05 2024-04-16T12:54:24.016 INFO:teuthology.orchestra.run.smithi171.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 1.1 MB/s | 225 kB 00:00 2024-04-16T12:54:24.099 INFO:teuthology.orchestra.run.smithi171.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 324 kB/s | 27 kB 00:00 2024-04-16T12:54:24.175 INFO:teuthology.orchestra.run.smithi171.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 422 kB/s | 32 kB 00:00 2024-04-16T12:54:24.226 INFO:teuthology.orchestra.run.smithi106.stdout:(8/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el9 3.1 MB/s | 10 MB 00:03 2024-04-16T12:54:24.383 INFO:teuthology.orchestra.run.smithi106.stdout:(9/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x86 4.8 MB/s | 17 MB 00:03 2024-04-16T12:54:24.391 INFO:teuthology.orchestra.run.smithi171.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 3.4 MB/s | 746 kB 00:00 2024-04-16T12:54:24.409 INFO:teuthology.orchestra.run.smithi106.stdout:(10/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el 137 kB/s | 25 kB 00:00 2024-04-16T12:54:24.467 INFO:teuthology.orchestra.run.smithi171.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 2.1 MB/s | 163 kB 00:00 2024-04-16T12:54:24.509 INFO:teuthology.orchestra.run.smithi106.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 2.2 MB/s | 225 kB 00:00 2024-04-16T12:54:24.542 INFO:teuthology.orchestra.run.smithi171.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 1.7 MB/s | 127 kB 00:00 2024-04-16T12:54:24.609 INFO:teuthology.orchestra.run.smithi106.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 271 kB/s | 27 kB 00:00 2024-04-16T12:54:24.710 INFO:teuthology.orchestra.run.smithi106.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 317 kB/s | 32 kB 00:00 2024-04-16T12:54:24.726 INFO:teuthology.orchestra.run.smithi171.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 2.7 MB/s | 500 kB 00:00 2024-04-16T12:54:24.943 INFO:teuthology.orchestra.run.smithi106.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 3.1 MB/s | 746 kB 00:00 2024-04-16T12:54:25.043 INFO:teuthology.orchestra.run.smithi106.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 1.6 MB/s | 163 kB 00:00 2024-04-16T12:54:25.152 INFO:teuthology.orchestra.run.smithi106.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 1.1 MB/s | 127 kB 00:00 2024-04-16T12:54:25.371 INFO:teuthology.orchestra.run.smithi106.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 2.3 MB/s | 500 kB 00:00 2024-04-16T12:54:26.902 INFO:teuthology.orchestra.run.smithi106.stdout:(18/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 3.4 MB/s | 5.2 MB 00:01 2024-04-16T12:54:26.909 INFO:teuthology.orchestra.run.smithi171.stdout:(18/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 2.4 MB/s | 5.2 MB 00:02 2024-04-16T12:54:26.976 INFO:teuthology.orchestra.run.smithi171.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 680 kB/s | 45 kB 00:00 2024-04-16T12:54:27.021 INFO:teuthology.orchestra.run.smithi106.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 388 kB/s | 45 kB 00:00 2024-04-16T12:54:27.051 INFO:teuthology.orchestra.run.smithi171.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 1.8 MB/s | 135 kB 00:00 2024-04-16T12:54:27.128 INFO:teuthology.orchestra.run.smithi106.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 1.2 MB/s | 135 kB 00:00 2024-04-16T12:54:27.177 INFO:teuthology.orchestra.run.smithi171.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 1.3 MB/s | 161 kB 00:00 2024-04-16T12:54:27.237 INFO:teuthology.orchestra.run.smithi106.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 1.5 MB/s | 161 kB 00:00 2024-04-16T12:54:27.352 INFO:teuthology.orchestra.run.smithi171.stdout:(22/174): python3-rados-19.0.0-2868.gc3c87ed0.e 1.8 MB/s | 320 kB 00:00 2024-04-16T12:54:27.353 INFO:teuthology.orchestra.run.smithi106.stdout:(22/174): python3-rados-19.0.0-2868.gc3c87ed0.e 2.7 MB/s | 320 kB 00:00 2024-04-16T12:54:27.462 INFO:teuthology.orchestra.run.smithi106.stdout:(23/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 2.7 MB/s | 298 kB 00:00 2024-04-16T12:54:27.469 INFO:teuthology.orchestra.run.smithi171.stdout:(23/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 2.5 MB/s | 298 kB 00:00 2024-04-16T12:54:27.552 INFO:teuthology.orchestra.run.smithi171.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.2 MB/s | 99 kB 00:00 2024-04-16T12:54:27.554 INFO:teuthology.orchestra.run.smithi106.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.1 MB/s | 99 kB 00:00 2024-04-16T12:54:27.636 INFO:teuthology.orchestra.run.smithi171.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-16T12:54:27.662 INFO:teuthology.orchestra.run.smithi106.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 789 kB/s | 85 kB 00:00 2024-04-16T12:54:28.562 INFO:teuthology.orchestra.run.smithi106.stdout:(26/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 3.4 MB/s | 3.1 MB 00:00 2024-04-16T12:54:28.663 INFO:teuthology.orchestra.run.smithi106.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-16T12:54:28.711 INFO:teuthology.orchestra.run.smithi171.stdout:(26/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 2.9 MB/s | 3.1 MB 00:01 2024-04-16T12:54:28.771 INFO:teuthology.orchestra.run.smithi106.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 316 kB/s | 34 kB 00:00 2024-04-16T12:54:28.795 INFO:teuthology.orchestra.run.smithi171.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-16T12:54:28.870 INFO:teuthology.orchestra.run.smithi171.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 457 kB/s | 34 kB 00:00 2024-04-16T12:54:28.871 INFO:teuthology.orchestra.run.smithi106.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 1.4 MB/s | 142 kB 00:00 2024-04-16T12:54:28.937 INFO:teuthology.orchestra.run.smithi171.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 2.1 MB/s | 142 kB 00:00 2024-04-16T12:54:29.880 INFO:teuthology.orchestra.run.smithi106.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 3.5 MB/s | 3.5 MB 00:01 2024-04-16T12:54:30.120 INFO:teuthology.orchestra.run.smithi171.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 3.0 MB/s | 3.5 MB 00:01 2024-04-16T12:54:31.829 INFO:teuthology.orchestra.run.smithi171.stdout:(31/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el 748 kB/s | 10 MB 00:13 2024-04-16T12:54:32.246 INFO:teuthology.orchestra.run.smithi171.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 598 kB/s | 249 kB 00:00 2024-04-16T12:54:32.346 INFO:teuthology.orchestra.run.smithi171.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 494 kB/s | 49 kB 00:00 2024-04-16T12:54:32.530 INFO:teuthology.orchestra.run.smithi171.stdout:(34/174): ceph-mgr-diskprediction-local-19.0.0- 3.1 MB/s | 7.4 MB 00:02 2024-04-16T12:54:32.555 INFO:teuthology.orchestra.run.smithi171.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2868.gc 79 kB/s | 16 kB 00:00 2024-04-16T12:54:32.572 INFO:teuthology.orchestra.run.smithi106.stdout:(31/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 5.9 MB/s | 49 MB 00:08 2024-04-16T12:54:32.664 INFO:teuthology.orchestra.run.smithi171.stdout:(36/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 1.9 MB/s | 264 kB 00:00 2024-04-16T12:54:32.664 INFO:teuthology.orchestra.run.smithi106.stdout:(32/174): ceph-mgr-diskprediction-local-19.0.0- 2.7 MB/s | 7.4 MB 00:02 2024-04-16T12:54:32.714 INFO:teuthology.orchestra.run.smithi106.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2868.gc3 1.7 MB/s | 249 kB 00:00 2024-04-16T12:54:32.739 INFO:teuthology.orchestra.run.smithi171.stdout:(37/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 243 kB/s | 18 kB 00:00 2024-04-16T12:54:32.785 INFO:teuthology.orchestra.run.smithi106.stdout:(34/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 423 kB/s | 49 kB 00:00 2024-04-16T12:54:32.806 INFO:teuthology.orchestra.run.smithi106.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2868.gc 179 kB/s | 16 kB 00:00 2024-04-16T12:54:33.001 INFO:teuthology.orchestra.run.smithi106.stdout:(36/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 1.2 MB/s | 264 kB 00:00 2024-04-16T12:54:33.001 INFO:teuthology.orchestra.run.smithi171.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 662 kB 00:00 2024-04-16T12:54:33.065 INFO:teuthology.orchestra.run.smithi171.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-04-16T12:54:33.074 INFO:teuthology.orchestra.run.smithi106.stdout:(37/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 2.8 MB/s | 762 kB 00:00 2024-04-16T12:54:33.106 INFO:teuthology.orchestra.run.smithi171.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-16T12:54:33.107 INFO:teuthology.orchestra.run.smithi106.stdout:(38/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 168 kB/s | 18 kB 00:00 2024-04-16T12:54:33.156 INFO:teuthology.orchestra.run.smithi171.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-04-16T12:54:33.182 INFO:teuthology.orchestra.run.smithi171.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2024-04-16T12:54:33.307 INFO:teuthology.orchestra.run.smithi171.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-16T12:54:33.332 INFO:teuthology.orchestra.run.smithi171.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 688 kB/s | 17 kB 00:00 2024-04-16T12:54:33.332 INFO:teuthology.orchestra.run.smithi106.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 662 kB 00:00 2024-04-16T12:54:33.357 INFO:teuthology.orchestra.run.smithi171.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 401 kB/s | 10 kB 00:00 2024-04-16T12:54:33.375 INFO:teuthology.orchestra.run.smithi106.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-16T12:54:33.391 INFO:teuthology.orchestra.run.smithi171.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-04-16T12:54:33.400 INFO:teuthology.orchestra.run.smithi106.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 920 kB 00:00 2024-04-16T12:54:33.425 INFO:teuthology.orchestra.run.smithi171.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-16T12:54:33.433 INFO:teuthology.orchestra.run.smithi106.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-04-16T12:54:33.459 INFO:teuthology.orchestra.run.smithi106.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 544 kB/s | 32 kB 00:00 2024-04-16T12:54:33.475 INFO:teuthology.orchestra.run.smithi171.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-16T12:54:33.550 INFO:teuthology.orchestra.run.smithi171.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2024-04-16T12:54:33.576 INFO:teuthology.orchestra.run.smithi106.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-04-16T12:54:33.584 INFO:teuthology.orchestra.run.smithi171.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-16T12:54:33.601 INFO:teuthology.orchestra.run.smithi106.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 17 kB 00:00 2024-04-16T12:54:33.627 INFO:teuthology.orchestra.run.smithi106.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 200 kB/s | 10 kB 00:00 2024-04-16T12:54:33.627 INFO:teuthology.orchestra.run.smithi171.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-04-16T12:54:33.652 INFO:teuthology.orchestra.run.smithi106.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-16T12:54:33.668 INFO:teuthology.orchestra.run.smithi171.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-04-16T12:54:33.677 INFO:teuthology.orchestra.run.smithi106.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-04-16T12:54:33.702 INFO:teuthology.orchestra.run.smithi106.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-16T12:54:33.710 INFO:teuthology.orchestra.run.smithi171.stdout:(53/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 660 kB/s | 762 kB 00:01 2024-04-16T12:54:33.741 INFO:teuthology.orchestra.run.smithi106.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-04-16T12:54:33.741 INFO:teuthology.orchestra.run.smithi171.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2024-04-16T12:54:33.752 INFO:teuthology.orchestra.run.smithi171.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 826 kB/s | 34 kB 00:00 2024-04-16T12:54:33.761 INFO:teuthology.orchestra.run.smithi106.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 805 kB/s | 46 kB 00:00 2024-04-16T12:54:33.795 INFO:teuthology.orchestra.run.smithi106.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-04-16T12:54:33.820 INFO:teuthology.orchestra.run.smithi106.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-04-16T12:54:33.862 INFO:teuthology.orchestra.run.smithi106.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2024-04-16T12:54:33.887 INFO:teuthology.orchestra.run.smithi106.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 512 kB/s | 34 kB 00:00 2024-04-16T12:54:33.894 INFO:teuthology.orchestra.run.smithi171.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-16T12:54:33.927 INFO:teuthology.orchestra.run.smithi171.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 8.7 MB/s | 1.5 MB 00:00 2024-04-16T12:54:33.961 INFO:teuthology.orchestra.run.smithi171.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 817 kB 00:00 2024-04-16T12:54:33.989 INFO:teuthology.orchestra.run.smithi171.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 132 kB 00:00 2024-04-16T12:54:34.021 INFO:teuthology.orchestra.run.smithi106.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-16T12:54:34.063 INFO:teuthology.orchestra.run.smithi106.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 8.8 MB/s | 1.5 MB 00:00 2024-04-16T12:54:34.124 INFO:teuthology.orchestra.run.smithi106.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 8.1 MB/s | 817 kB 00:00 2024-04-16T12:54:34.150 INFO:teuthology.orchestra.run.smithi106.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 1.5 MB/s | 132 kB 00:00 2024-04-16T12:54:34.162 INFO:teuthology.orchestra.run.smithi171.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 29 MB/s | 5.7 MB 00:00 2024-04-16T12:54:34.195 INFO:teuthology.orchestra.run.smithi171.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-04-16T12:54:34.220 INFO:teuthology.orchestra.run.smithi171.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-04-16T12:54:34.347 INFO:teuthology.orchestra.run.smithi106.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2024-04-16T12:54:34.406 INFO:teuthology.orchestra.run.smithi106.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-04-16T12:54:34.433 INFO:teuthology.orchestra.run.smithi106.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 945 kB/s | 78 kB 00:00 2024-04-16T12:54:34.440 INFO:teuthology.orchestra.run.smithi171.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 5.8 MB 00:00 2024-04-16T12:54:34.469 INFO:teuthology.orchestra.run.smithi171.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 101 kB/s | 24 kB 00:00 2024-04-16T12:54:34.488 INFO:teuthology.orchestra.run.smithi171.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 361 kB/s | 18 kB 00:00 2024-04-16T12:54:34.513 INFO:teuthology.orchestra.run.smithi171.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-16T12:54:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2024-04-16T12:54:34.598 INFO:teuthology.orchestra.run.smithi106.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-04-16T12:54:34.615 INFO:teuthology.orchestra.run.smithi106.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 134 kB/s | 24 kB 00:00 2024-04-16T12:54:34.659 INFO:teuthology.orchestra.run.smithi106.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 307 kB/s | 18 kB 00:00 2024-04-16T12:54:34.682 INFO:teuthology.orchestra.run.smithi106.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-04-16T12:54:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-04-16T12:54:34.707 INFO:teuthology.orchestra.run.smithi106.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2024-04-16T12:54:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-04-16T12:54:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2024-04-16T12:54:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-04-16T12:54:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 821 kB/s | 41 kB 00:00 2024-04-16T12:54:34.842 INFO:teuthology.orchestra.run.smithi171.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-04-16T12:54:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-04-16T12:54:34.866 INFO:teuthology.orchestra.run.smithi106.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-04-16T12:54:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-04-16T12:54:34.891 INFO:teuthology.orchestra.run.smithi106.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-04-16T12:54:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-04-16T12:54:34.916 INFO:teuthology.orchestra.run.smithi106.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-04-16T12:54:34.933 INFO:teuthology.orchestra.run.smithi171.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2024-04-16T12:54:34.942 INFO:teuthology.orchestra.run.smithi106.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-04-16T12:54:34.968 INFO:teuthology.orchestra.run.smithi106.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 816 kB/s | 41 kB 00:00 2024-04-16T12:54:35.009 INFO:teuthology.orchestra.run.smithi106.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-04-16T12:54:35.034 INFO:teuthology.orchestra.run.smithi106.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-04-16T12:54:35.068 INFO:teuthology.orchestra.run.smithi106.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2024-04-16T12:54:35.094 INFO:teuthology.orchestra.run.smithi106.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 810 kB/s | 47 kB 00:00 2024-04-16T12:54:35.118 INFO:teuthology.orchestra.run.smithi106.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2024-04-16T12:54:35.252 INFO:teuthology.orchestra.run.smithi171.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 122 kB/s | 39 kB 00:00 2024-04-16T12:54:35.485 INFO:teuthology.orchestra.run.smithi106.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 105 kB/s | 39 kB 00:00 2024-04-16T12:54:35.583 INFO:teuthology.orchestra.run.smithi171.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-04-16T12:54:35.601 INFO:teuthology.orchestra.run.smithi171.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 117 kB/s | 41 kB 00:00 2024-04-16T12:54:35.626 INFO:teuthology.orchestra.run.smithi171.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2024-04-16T12:54:35.643 INFO:teuthology.orchestra.run.smithi171.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 837 kB/s | 35 kB 00:00 2024-04-16T12:54:35.660 INFO:teuthology.orchestra.run.smithi171.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.3 MB/s | 46 kB 00:00 2024-04-16T12:54:35.685 INFO:teuthology.orchestra.run.smithi171.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-04-16T12:54:35.702 INFO:teuthology.orchestra.run.smithi171.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-04-16T12:54:35.719 INFO:teuthology.orchestra.run.smithi106.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-16T12:54:35.719 INFO:teuthology.orchestra.run.smithi171.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-16T12:54:35.736 INFO:teuthology.orchestra.run.smithi171.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-16T12:54:35.744 INFO:teuthology.orchestra.run.smithi106.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 159 kB/s | 41 kB 00:00 2024-04-16T12:54:35.752 INFO:teuthology.orchestra.run.smithi171.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-04-16T12:54:35.770 INFO:teuthology.orchestra.run.smithi106.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-16T12:54:35.779 INFO:teuthology.orchestra.run.smithi171.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-04-16T12:54:35.795 INFO:teuthology.orchestra.run.smithi106.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 699 kB/s | 35 kB 00:00 2024-04-16T12:54:35.820 INFO:teuthology.orchestra.run.smithi106.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 925 kB/s | 46 kB 00:00 2024-04-16T12:54:35.845 INFO:teuthology.orchestra.run.smithi171.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-04-16T12:54:35.845 INFO:teuthology.orchestra.run.smithi106.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-04-16T12:54:35.862 INFO:teuthology.orchestra.run.smithi171.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-04-16T12:54:35.871 INFO:teuthology.orchestra.run.smithi106.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-04-16T12:54:35.889 INFO:teuthology.orchestra.run.smithi171.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.9 MB/s | 124 kB 00:00 2024-04-16T12:54:35.898 INFO:teuthology.orchestra.run.smithi106.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-04-16T12:54:35.921 INFO:teuthology.orchestra.run.smithi171.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 187 kB 00:00 2024-04-16T12:54:35.921 INFO:teuthology.orchestra.run.smithi106.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2024-04-16T12:54:35.947 INFO:teuthology.orchestra.run.smithi106.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-04-16T12:54:35.972 INFO:teuthology.orchestra.run.smithi106.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-04-16T12:54:36.045 INFO:teuthology.orchestra.run.smithi106.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-04-16T12:54:36.046 INFO:teuthology.orchestra.run.smithi171.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-04-16T12:54:36.065 INFO:teuthology.orchestra.run.smithi106.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-04-16T12:54:36.088 INFO:teuthology.orchestra.run.smithi171.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-04-16T12:54:36.089 INFO:teuthology.orchestra.run.smithi106.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-04-16T12:54:36.106 INFO:teuthology.orchestra.run.smithi106.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 4.4 MB/s | 187 kB 00:00 2024-04-16T12:54:36.113 INFO:teuthology.orchestra.run.smithi171.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-16T12:54:36.140 INFO:teuthology.orchestra.run.smithi171.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-16T12:54:36.224 INFO:teuthology.orchestra.run.smithi171.stdout:(98/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-04-16T12:54:36.239 INFO:teuthology.orchestra.run.smithi171.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 171 kB/s | 21 kB 00:00 2024-04-16T12:54:36.348 INFO:teuthology.orchestra.run.smithi171.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.2 MB/s | 245 kB 00:00 2024-04-16T12:54:36.357 INFO:teuthology.orchestra.run.smithi106.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 701 kB/s | 187 kB 00:00 2024-04-16T12:54:36.398 INFO:teuthology.orchestra.run.smithi171.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 4.9 MB/s | 248 kB 00:00 2024-04-16T12:54:36.465 INFO:teuthology.orchestra.run.smithi171.stdout:(102/174): openssl-devel-3.0.7-27.el9.x86_64.rp 17 MB/s | 4.1 MB 00:00 2024-04-16T12:54:36.490 INFO:teuthology.orchestra.run.smithi171.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-04-16T12:54:36.515 INFO:teuthology.orchestra.run.smithi171.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-04-16T12:54:36.565 INFO:teuthology.orchestra.run.smithi171.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-04-16T12:54:36.618 INFO:teuthology.orchestra.run.smithi106.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 748 kB/s | 195 kB 00:00 2024-04-16T12:54:36.674 INFO:teuthology.orchestra.run.smithi106.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-04-16T12:54:36.700 INFO:teuthology.orchestra.run.smithi106.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-16T12:54:36.750 INFO:teuthology.orchestra.run.smithi106.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 286 kB/s | 21 kB 00:00 2024-04-16T12:54:36.767 INFO:teuthology.orchestra.run.smithi106.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-16T12:54:36.857 INFO:teuthology.orchestra.run.smithi171.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-04-16T12:54:36.859 INFO:teuthology.orchestra.run.smithi106.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.6 MB/s | 245 kB 00:00 2024-04-16T12:54:36.899 INFO:teuthology.orchestra.run.smithi171.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-04-16T12:54:36.909 INFO:teuthology.orchestra.run.smithi106.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 4.9 MB/s | 248 kB 00:00 2024-04-16T12:54:36.925 INFO:teuthology.orchestra.run.smithi171.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2024-04-16T12:54:36.976 INFO:teuthology.orchestra.run.smithi106.stdout:(102/174): openssl-devel-3.0.7-27.el9.x86_64.rp 18 MB/s | 4.1 MB 00:00 2024-04-16T12:54:37.001 INFO:teuthology.orchestra.run.smithi106.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-04-16T12:54:37.035 INFO:teuthology.orchestra.run.smithi106.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-04-16T12:54:37.133 INFO:teuthology.orchestra.run.smithi171.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 125 kB/s | 26 kB 00:00 2024-04-16T12:54:37.252 INFO:teuthology.orchestra.run.smithi106.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-04-16T12:54:37.344 INFO:teuthology.orchestra.run.smithi106.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-04-16T12:54:37.350 INFO:teuthology.orchestra.run.smithi171.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 224 kB/s | 49 kB 00:00 2024-04-16T12:54:37.402 INFO:teuthology.orchestra.run.smithi106.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-04-16T12:54:37.484 INFO:teuthology.orchestra.run.smithi171.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 505 kB/s | 67 kB 00:00 2024-04-16T12:54:37.553 INFO:teuthology.orchestra.run.smithi106.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-04-16T12:54:37.593 INFO:teuthology.orchestra.run.smithi171.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-04-16T12:54:37.619 INFO:teuthology.orchestra.run.smithi106.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-04-16T12:54:37.686 INFO:teuthology.orchestra.run.smithi106.stdout:(110/174): libarrow-9.0.0-10.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-04-16T12:54:37.712 INFO:teuthology.orchestra.run.smithi106.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-04-16T12:54:37.746 INFO:teuthology.orchestra.run.smithi106.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-16T12:54:37.795 INFO:teuthology.orchestra.run.smithi106.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-16T12:54:37.821 INFO:teuthology.orchestra.run.smithi171.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.8 MB/s | 838 kB 00:00 2024-04-16T12:54:37.829 INFO:teuthology.orchestra.run.smithi106.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-04-16T12:54:37.904 INFO:teuthology.orchestra.run.smithi106.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 580 kB/s | 43 kB 00:00 2024-04-16T12:54:37.950 INFO:teuthology.orchestra.run.smithi106.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-04-16T12:54:37.966 INFO:teuthology.orchestra.run.smithi171.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-04-16T12:54:37.980 INFO:teuthology.orchestra.run.smithi106.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-04-16T12:54:38.019 INFO:teuthology.orchestra.run.smithi171.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 651 kB/s | 43 kB 00:00 2024-04-16T12:54:38.019 INFO:teuthology.orchestra.run.smithi106.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-04-16T12:54:38.047 INFO:teuthology.orchestra.run.smithi106.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-16T12:54:38.114 INFO:teuthology.orchestra.run.smithi106.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-16T12:54:38.143 INFO:teuthology.orchestra.run.smithi106.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-16T12:54:38.143 INFO:teuthology.orchestra.run.smithi171.stdout:(116/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-04-16T12:54:38.161 INFO:teuthology.orchestra.run.smithi171.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 227 kB/s | 32 kB 00:00 2024-04-16T12:54:38.190 INFO:teuthology.orchestra.run.smithi106.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-04-16T12:54:38.221 INFO:teuthology.orchestra.run.smithi171.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-16T12:54:38.223 INFO:teuthology.orchestra.run.smithi106.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-04-16T12:54:38.245 INFO:teuthology.orchestra.run.smithi171.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-16T12:54:38.316 INFO:teuthology.orchestra.run.smithi106.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-04-16T12:54:38.345 INFO:teuthology.orchestra.run.smithi171.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-04-16T12:54:38.370 INFO:teuthology.orchestra.run.smithi171.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-04-16T12:54:38.383 INFO:teuthology.orchestra.run.smithi106.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2024-04-16T12:54:38.403 INFO:teuthology.orchestra.run.smithi171.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 604 kB/s | 35 kB 00:00 2024-04-16T12:54:38.439 INFO:teuthology.orchestra.run.smithi171.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-04-16T12:54:38.449 INFO:teuthology.orchestra.run.smithi106.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-04-16T12:54:38.483 INFO:teuthology.orchestra.run.smithi106.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 7.0 MB/s | 2.0 MB 00:00 2024-04-16T12:54:38.512 INFO:teuthology.orchestra.run.smithi171.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-16T12:54:38.517 INFO:teuthology.orchestra.run.smithi106.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2024-04-16T12:54:38.542 INFO:teuthology.orchestra.run.smithi106.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-04-16T12:54:38.571 INFO:teuthology.orchestra.run.smithi171.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-04-16T12:54:38.576 INFO:teuthology.orchestra.run.smithi106.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-04-16T12:54:38.638 INFO:teuthology.orchestra.run.smithi171.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-04-16T12:54:38.646 INFO:teuthology.orchestra.run.smithi106.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-04-16T12:54:38.668 INFO:teuthology.orchestra.run.smithi106.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 505 kB/s | 46 kB 00:00 2024-04-16T12:54:38.696 INFO:teuthology.orchestra.run.smithi171.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 399 kB/s | 23 kB 00:00 2024-04-16T12:54:38.701 INFO:teuthology.orchestra.run.smithi106.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-16T12:54:38.735 INFO:teuthology.orchestra.run.smithi106.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-04-16T12:54:38.747 INFO:teuthology.orchestra.run.smithi171.stdout:(128/174): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-04-16T12:54:38.772 INFO:teuthology.orchestra.run.smithi106.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-16T12:54:38.772 INFO:teuthology.orchestra.run.smithi171.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-04-16T12:54:38.785 INFO:teuthology.orchestra.run.smithi106.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-04-16T12:54:38.806 INFO:teuthology.orchestra.run.smithi171.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-04-16T12:54:38.839 INFO:teuthology.orchestra.run.smithi106.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-16T12:54:38.853 INFO:teuthology.orchestra.run.smithi106.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-04-16T12:54:38.865 INFO:teuthology.orchestra.run.smithi171.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 794 kB/s | 46 kB 00:00 2024-04-16T12:54:38.895 INFO:teuthology.orchestra.run.smithi106.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 528 kB/s | 31 kB 00:00 2024-04-16T12:54:38.920 INFO:teuthology.orchestra.run.smithi106.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-04-16T12:54:38.940 INFO:teuthology.orchestra.run.smithi171.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-04-16T12:54:38.954 INFO:teuthology.orchestra.run.smithi106.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-16T12:54:38.975 INFO:teuthology.orchestra.run.smithi171.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-04-16T12:54:38.980 INFO:teuthology.orchestra.run.smithi106.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-04-16T12:54:39.000 INFO:teuthology.orchestra.run.smithi171.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-04-16T12:54:39.040 INFO:teuthology.orchestra.run.smithi171.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-16T12:54:39.074 INFO:teuthology.orchestra.run.smithi171.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-16T12:54:39.119 INFO:teuthology.orchestra.run.smithi171.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-16T12:54:39.129 INFO:teuthology.orchestra.run.smithi106.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 291 kB/s | 51 kB 00:00 2024-04-16T12:54:39.133 INFO:teuthology.orchestra.run.smithi171.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-04-16T12:54:39.155 INFO:teuthology.orchestra.run.smithi106.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-04-16T12:54:39.175 INFO:teuthology.orchestra.run.smithi171.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-04-16T12:54:39.189 INFO:teuthology.orchestra.run.smithi106.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-16T12:54:39.217 INFO:teuthology.orchestra.run.smithi171.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-16T12:54:39.230 INFO:teuthology.orchestra.run.smithi106.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-16T12:54:39.242 INFO:teuthology.orchestra.run.smithi171.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 881 kB/s | 59 kB 00:00 2024-04-16T12:54:39.255 INFO:teuthology.orchestra.run.smithi106.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-04-16T12:54:39.276 INFO:teuthology.orchestra.run.smithi171.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 608 kB/s | 36 kB 00:00 2024-04-16T12:54:39.309 INFO:teuthology.orchestra.run.smithi106.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-16T12:54:39.318 INFO:teuthology.orchestra.run.smithi171.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 679 kB/s | 51 kB 00:00 2024-04-16T12:54:39.362 INFO:teuthology.orchestra.run.smithi171.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-16T12:54:39.394 INFO:teuthology.orchestra.run.smithi171.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-16T12:54:39.394 INFO:teuthology.orchestra.run.smithi106.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-16T12:54:39.461 INFO:teuthology.orchestra.run.smithi171.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 300 kB/s | 20 kB 00:00 2024-04-16T12:54:39.494 INFO:teuthology.orchestra.run.smithi171.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-04-16T12:54:39.527 INFO:teuthology.orchestra.run.smithi171.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-16T12:54:39.721 INFO:teuthology.orchestra.run.smithi171.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-04-16T12:54:40.756 INFO:teuthology.orchestra.run.smithi106.stdout:(150/174): librados2-19.0.0-2868.gc3c87ed0.el9. 2.3 MB/s | 3.4 MB 00:01 2024-04-16T12:54:40.915 INFO:teuthology.orchestra.run.smithi106.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-04-16T12:54:41.057 INFO:teuthology.orchestra.run.smithi106.stdout:(152/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 1.9 MB/s | 3.1 MB 00:01 2024-04-16T12:54:41.132 INFO:teuthology.orchestra.run.smithi106.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 8.4 MB/s | 1.8 MB 00:00 2024-04-16T12:54:41.159 INFO:teuthology.orchestra.run.smithi106.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 411 kB/s | 41 kB 00:00 2024-04-16T12:54:41.192 INFO:teuthology.orchestra.run.smithi106.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.1 MB/s | 248 kB 00:00 2024-04-16T12:54:41.216 INFO:teuthology.orchestra.run.smithi106.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-04-16T12:54:41.409 INFO:teuthology.orchestra.run.smithi106.stdout:(157/174): ceph-common-19.0.0-2868.gc3c87ed0.el 898 kB/s | 21 MB 00:23 2024-04-16T12:54:41.433 INFO:teuthology.orchestra.run.smithi106.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 168 kB/s | 36 kB 00:00 2024-04-16T12:54:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:(159/174): acl-2.3.1-4.el9.x86_64.rpm 267 kB/s | 71 kB 00:00 2024-04-16T12:54:41.517 INFO:teuthology.orchestra.run.smithi106.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 396 kB/s | 23 kB 00:00 2024-04-16T12:54:41.543 INFO:teuthology.orchestra.run.smithi106.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.3 MB/s | 256 kB 00:00 2024-04-16T12:54:41.601 INFO:teuthology.orchestra.run.smithi106.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 108 kB 00:00 2024-04-16T12:54:41.626 INFO:teuthology.orchestra.run.smithi106.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-04-16T12:54:41.660 INFO:teuthology.orchestra.run.smithi106.stdout:(164/174): elfutils-libelf-0.190-2.el9.x86_64.r 765 kB/s | 192 kB 00:00 2024-04-16T12:54:41.686 INFO:teuthology.orchestra.run.smithi106.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 136 kB 00:00 2024-04-16T12:54:41.711 INFO:teuthology.orchestra.run.smithi106.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 761 kB/s | 64 kB 00:00 2024-04-16T12:54:41.737 INFO:teuthology.orchestra.run.smithi106.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 380 kB/s | 29 kB 00:00 2024-04-16T12:54:42.253 INFO:teuthology.orchestra.run.smithi106.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 4.0 MB/s | 2.2 MB 00:00 2024-04-16T12:54:42.328 INFO:teuthology.orchestra.run.smithi106.stdout:(169/174): openssl-3.0.7-27.el9.x86_64.rpm 1.9 MB/s | 1.2 MB 00:00 2024-04-16T12:54:42.353 INFO:teuthology.orchestra.run.smithi106.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 4.5 MB/s | 465 kB 00:00 2024-04-16T12:54:42.387 INFO:teuthology.orchestra.run.smithi106.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 533 kB/s | 31 kB 00:00 2024-04-16T12:54:42.471 INFO:teuthology.orchestra.run.smithi106.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 892 kB/s | 74 kB 00:00 2024-04-16T12:54:42.504 INFO:teuthology.orchestra.run.smithi106.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.1 MB/s | 1.1 MB 00:00 2024-04-16T12:54:42.613 INFO:teuthology.orchestra.run.smithi106.stdout:(174/174): util-linux-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 2.3 MB 00:00 2024-04-16T12:54:42.618 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:54:42.619 INFO:teuthology.orchestra.run.smithi106.stdout:Total 8.8 MB/s | 228 MB 00:25 2024-04-16T12:54:42.987 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-04-16T12:54:43.259 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-04-16T12:54:43.259 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-04-16T12:54:44.553 INFO:teuthology.orchestra.run.smithi171.stdout:(150/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 666 kB/s | 3.1 MB 00:04 2024-04-16T12:54:44.728 INFO:teuthology.orchestra.run.smithi171.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-04-16T12:54:44.870 INFO:teuthology.orchestra.run.smithi171.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-04-16T12:54:44.945 INFO:teuthology.orchestra.run.smithi171.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 543 kB/s | 41 kB 00:00 2024-04-16T12:54:45.029 INFO:teuthology.orchestra.run.smithi171.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 2.9 MB/s | 248 kB 00:00 2024-04-16T12:54:45.113 INFO:teuthology.orchestra.run.smithi171.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2024-04-16T12:54:45.179 INFO:teuthology.orchestra.run.smithi171.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-04-16T12:54:45.221 INFO:teuthology.orchestra.run.smithi171.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 879 kB/s | 36 kB 00:00 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi171.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-16T12:54:45.326 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-04-16T12:54:45.327 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-04-16T12:54:45.349 INFO:teuthology.orchestra.run.smithi171.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-04-16T12:54:45.405 INFO:teuthology.orchestra.run.smithi171.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 394 kB/s | 23 kB 00:00 2024-04-16T12:54:45.481 INFO:teuthology.orchestra.run.smithi171.stdout:(161/174): librados2-19.0.0-2868.gc3c87ed0.el9. 584 kB/s | 3.4 MB 00:05 2024-04-16T12:54:45.506 INFO:teuthology.orchestra.run.smithi171.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 108 kB 00:00 2024-04-16T12:54:45.539 INFO:teuthology.orchestra.run.smithi171.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 4.0 MB/s | 136 kB 00:00 2024-04-16T12:54:45.573 INFO:teuthology.orchestra.run.smithi171.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 155 kB 00:00 2024-04-16T12:54:45.598 INFO:teuthology.orchestra.run.smithi171.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-04-16T12:54:45.623 INFO:teuthology.orchestra.run.smithi171.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 572 kB/s | 29 kB 00:00 2024-04-16T12:54:45.682 INFO:teuthology.orchestra.run.smithi171.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-04-16T12:54:45.766 INFO:teuthology.orchestra.run.smithi171.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 27 MB/s | 2.3 MB 00:00 2024-04-16T12:54:45.807 INFO:teuthology.orchestra.run.smithi171.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-04-16T12:54:45.850 INFO:teuthology.orchestra.run.smithi171.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 5.4 MB/s | 465 kB 00:00 2024-04-16T12:54:45.875 INFO:teuthology.orchestra.run.smithi171.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 463 kB/s | 31 kB 00:00 2024-04-16T12:54:45.917 INFO:teuthology.orchestra.run.smithi171.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-04-16T12:54:45.960 INFO:teuthology.orchestra.run.smithi171.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 892 kB/s | 74 kB 00:00 2024-04-16T12:54:52.274 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-04-16T12:54:52.382 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T12:54:52.424 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T12:54:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:54:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:54:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T12:54:52.590 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T12:54:52.624 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T12:54:52.649 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T12:54:52.701 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T12:54:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T12:54:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:54:53.214 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:54:53.243 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:54:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:54:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:54:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T12:54:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T12:54:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T12:54:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:54:53.744 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:54:53.766 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:54:53.840 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:54:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T12:54:53.901 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:54:53.918 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:54:54.071 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:54:54.102 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:54:54.134 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T12:54:54.296 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T12:54:54.443 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:54:54.487 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:54:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:54:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:54:54.892 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:54:55.001 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T12:54:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T12:54:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T12:54:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T12:54:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T12:54:55.254 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T12:54:55.308 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T12:54:55.347 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T12:54:55.410 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T12:54:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T12:54:55.497 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T12:54:55.544 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T12:54:55.578 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T12:54:55.644 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T12:54:55.680 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T12:54:55.723 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T12:54:55.752 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T12:54:55.812 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T12:54:55.858 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T12:54:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T12:54:56.063 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T12:54:56.119 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T12:54:56.634 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T12:54:56.714 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T12:54:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T12:54:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:54:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:54:56.883 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T12:54:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T12:54:56.969 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T12:54:56.991 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T12:54:57.259 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T12:54:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T12:54:57.509 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T12:54:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T12:54:57.694 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T12:54:57.748 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T12:54:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T12:54:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T12:54:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T12:54:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T12:54:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T12:54:58.018 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T12:54:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T12:54:58.103 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T12:54:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T12:54:58.275 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T12:54:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T12:54:58.347 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T12:54:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T12:54:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T12:54:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T12:54:58.554 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T12:54:58.579 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T12:54:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T12:54:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T12:54:58.882 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T12:54:58.929 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T12:54:58.976 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T12:54:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T12:54:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T12:54:59.257 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T12:54:59.378 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T12:54:59.422 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T12:54:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T12:54:59.512 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:54:59.547 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T12:54:59.581 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T12:54:59.620 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T12:54:59.652 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T12:54:59.682 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T12:54:59.750 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T12:54:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T12:54:59.834 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T12:54:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T12:54:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T12:55:00.015 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T12:55:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T12:55:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T12:55:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T12:55:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T12:55:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T12:55:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T12:55:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T12:55:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T12:55:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T12:55:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T12:55:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T12:55:01.338 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T12:55:01.515 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T12:55:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T12:55:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T12:55:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T12:55:02.356 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T12:55:03.558 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T12:55:03.636 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T12:55:03.667 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T12:55:03.698 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T12:55:03.725 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T12:55:04.037 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T12:55:04.072 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:55:04.163 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:55:04.193 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T12:55:04.230 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T12:55:04.697 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T12:55:04.725 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:55:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:55:04.818 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T12:55:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:55:07.023 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:55:07.577 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:55:07.610 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:55:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:55:07.693 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T12:55:07.693 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T12:55:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:55:14.572 INFO:teuthology.orchestra.run.smithi171.stdout:(174/174): ceph-test-19.0.0-2868.gc3c87ed0.el9. 910 kB/s | 49 MB 00:54 2024-04-16T12:55:14.576 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:55:14.576 INFO:teuthology.orchestra.run.smithi171.stdout:Total 3.6 MB/s | 228 MB 01:03 2024-04-16T12:55:14.944 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-16T12:55:15.219 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-16T12:55:15.219 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-16T12:55:17.237 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-16T12:55:17.237 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /root 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2024-04-16T12:55:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:19.664 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:55:19.679 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:55:19.679 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:19.679 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T12:55:19.679 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:21.179 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T12:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:55:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:55:21.459 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:21.459 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T12:55:21.459 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:55:21.459 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:55:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:55:21.926 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:55:21.926 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:21.926 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T12:55:21.926 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:55:21.926 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:55:21.926 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:22.013 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T12:55:22.433 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:55:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:55:22.502 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T12:55:22.563 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T12:55:22.593 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:55:23.627 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:55:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:55:24.218 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-16T12:55:24.311 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T12:55:24.352 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T12:55:24.390 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:55:24.400 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:55:24.442 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T12:55:24.502 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T12:55:24.535 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T12:55:24.571 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T12:55:24.613 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T12:55:24.623 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:55:24.646 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:55:24.744 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:55:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T12:55:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:55:24.959 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T12:55:24.962 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:55:24.962 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:24.962 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T12:55:24.962 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:55:24.962 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:55:24.962 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:55:25.012 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:55:25.017 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:55:25.068 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T12:55:25.134 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:55:25.164 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:55:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:55:25.285 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:55:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T12:55:25.504 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T12:55:25.558 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T12:55:25.585 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:55:25.672 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:55:25.694 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:55:25.743 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:55:25.782 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T12:55:25.804 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:55:25.820 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:55:25.960 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T12:55:25.981 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:55:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:55:26.011 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:55:26.023 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:55:26.024 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:26.024 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T12:55:26.024 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:55:26.024 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:55:26.024 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:26.050 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T12:55:26.067 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:55:26.090 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:55:26.090 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:26.090 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T12:55:26.090 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:26.135 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:55:26.157 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:55:26.157 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:26.157 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T12:55:26.157 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:55:26.158 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:55:26.158 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:26.233 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T12:55:26.368 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:55:26.429 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:55:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:55:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:55:26.485 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:26.486 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T12:55:26.486 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:55:26.486 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:55:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:26.530 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:55:26.580 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:55:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:55:26.942 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T12:55:27.038 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T12:55:27.102 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T12:55:27.128 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T12:55:27.164 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T12:55:27.237 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T12:55:27.291 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T12:55:27.330 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T12:55:27.394 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T12:55:27.429 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T12:55:27.472 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T12:55:27.505 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T12:55:27.533 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T12:55:27.601 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T12:55:27.637 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T12:55:27.681 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T12:55:27.709 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T12:55:27.779 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T12:55:27.826 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T12:55:27.900 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T12:55:28.032 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T12:55:28.087 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T12:55:28.602 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T12:55:28.684 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T12:55:28.770 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T12:55:28.830 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:55:28.840 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:55:28.887 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T12:55:28.928 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T12:55:28.966 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T12:55:28.997 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T12:55:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T12:55:29.443 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T12:55:29.526 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T12:55:29.587 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T12:55:29.724 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T12:55:29.774 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T12:55:29.829 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T12:55:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T12:55:29.942 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T12:55:29.979 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T12:55:30.026 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T12:55:30.061 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T12:55:30.104 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T12:55:30.147 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T12:55:30.280 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T12:55:30.338 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T12:55:30.370 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T12:55:30.409 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T12:55:30.504 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T12:55:30.543 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T12:55:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T12:55:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T12:55:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T12:55:30.705 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T12:55:30.827 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T12:55:30.943 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T12:55:30.985 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T12:55:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:55:31.034 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T12:55:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T12:55:31.099 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T12:55:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T12:55:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T12:55:31.282 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T12:55:31.308 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T12:55:31.324 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T12:55:31.420 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T12:55:31.461 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T12:55:31.469 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T12:55:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T12:55:31.527 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T12:55:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T12:55:31.578 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:55:31.586 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T12:55:31.606 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T12:55:31.614 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T12:55:31.640 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T12:55:31.647 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T12:55:31.671 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T12:55:31.680 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T12:55:31.700 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T12:55:31.720 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T12:55:31.750 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T12:55:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T12:55:31.818 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T12:55:31.852 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T12:55:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T12:55:31.886 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T12:55:31.890 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T12:55:31.927 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T12:55:31.962 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T12:55:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T12:55:32.133 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T12:55:32.185 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T12:55:32.217 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T12:55:32.264 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T12:55:32.361 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T12:55:32.411 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T12:55:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:55:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:55:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:55:33.141 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T12:55:33.195 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T12:55:33.226 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T12:55:33.274 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T12:55:33.354 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T12:55:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T12:55:33.395 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T12:55:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T12:55:33.500 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T12:55:33.573 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T12:55:33.590 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T12:55:33.601 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T12:55:33.620 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T12:55:33.645 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T12:55:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T12:55:33.680 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T12:55:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T12:55:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:55:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:55:33.823 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T12:55:33.823 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:55:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:55:33.934 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T12:55:33.967 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T12:55:33.992 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T12:55:34.017 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T12:55:34.070 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T12:55:34.116 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T12:55:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T12:55:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T12:55:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T12:55:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:55:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T12:55:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:55:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:55:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T12:55:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:55:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:55:34.445 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T12:55:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:55:34.532 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:55:34.559 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T12:55:34.585 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T12:55:34.618 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T12:55:34.684 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:55:35.670 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T12:55:35.752 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T12:55:35.783 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T12:55:35.815 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T12:55:35.844 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T12:55:36.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T12:55:36.198 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:55:36.281 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:55:36.313 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T12:55:36.348 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T12:55:36.820 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T12:55:36.852 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:55:36.907 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:55:36.937 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T12:55:39.174 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:55:39.219 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:55:39.774 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:55:39.814 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:55:39.889 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:55:39.889 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T12:55:39.889 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T12:55:39.889 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T12:55:40.078 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T12:55:40.079 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T12:55:40.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T12:55:40.081 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T12:55:40.082 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T12:55:40.083 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T12:55:40.084 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T12:55:40.085 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T12:55:40.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T12:55:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T12:55:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T12:55:40.089 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T12:55:40.090 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T12:55:40.091 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T12:55:40.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T12:55:43.224 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T12:55:43.225 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T12:55:43.226 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.227 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.228 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: jq-1.6-16.el9.x86_64 2024-04-16T12:55:43.229 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.230 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T12:55:43.231 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.232 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T12:55:43.233 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T12:55:43.234 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.235 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T12:55:43.236 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T12:55:43.237 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T12:55:43.238 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T12:55:43.238 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:55:43.239 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-04-16T12:55:43.711 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:52.069 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:55:52.069 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-04-16T12:55:52.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-04-16T12:55:52.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-04-16T12:55:52.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-04-16T12:55:52.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-04-16T12:55:52.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-04-16T12:55:52.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-04-16T12:55:52.070 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:52.242 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:55:52.258 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:55:52.258 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:52.258 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T12:55:52.258 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:53.755 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:55:53.781 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:55:53.781 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:53.781 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T12:55:53.781 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:55:53.782 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:55:53.782 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:54.005 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:55:54.028 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:55:54.029 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:54.029 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T12:55:54.029 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:55:54.029 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:55:54.029 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:54.473 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:55:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:55:54.496 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:54.496 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T12:55:54.496 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:55:54.496 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:55:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:54.583 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T12:55:55.038 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:55:55.067 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:55:55.099 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T12:55:55.163 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T12:55:55.191 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:55:56.236 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:55:56.276 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:55:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:55:57.285 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:55:57.386 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:55:57.549 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T12:55:57.579 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:55:57.603 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:55:57.603 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:57.603 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T12:55:57.603 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:55:57.603 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:55:57.603 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:57.647 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:55:57.658 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:55:57.710 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T12:55:58.603 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T12:55:58.642 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:55:58.665 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:55:58.665 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:58.665 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T12:55:58.665 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:55:58.666 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:55:58.666 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:58.709 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:55:58.731 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:55:58.732 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:58.732 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T12:55:58.732 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:58.776 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:55:58.799 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:55:58.799 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:58.800 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T12:55:58.800 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:55:58.800 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:55:58.800 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:55:59.135 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:55:59.158 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:55:59.158 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:55:59.158 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T12:55:59.158 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:55:59.158 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:55:59.158 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:03.785 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:56:03.826 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T12:56:03.857 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T12:56:03.884 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T12:56:04.068 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T12:56:04.185 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T12:56:04.226 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T12:56:04.276 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T12:56:04.335 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T12:56:04.395 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T12:56:04.427 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T12:56:04.457 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T12:56:04.520 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T12:56:04.599 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T12:56:04.631 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T12:56:05.157 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:56:05.198 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:56:05.218 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:56:06.039 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T12:56:06.122 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T12:56:06.162 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T12:56:06.249 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T12:56:06.285 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T12:56:06.310 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T12:56:06.336 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T12:56:06.362 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T12:56:06.362 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:56:06.450 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:56:06.488 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T12:56:06.488 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:56:06.573 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:56:06.600 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T12:56:06.633 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T12:56:06.659 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T12:56:06.684 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T12:56:06.720 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T12:56:06.769 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T12:56:06.798 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T12:56:06.827 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T12:56:06.875 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:56:06.900 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T12:56:06.907 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:56:06.907 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:56:07.087 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:56:07.087 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:56:07.169 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:56:07.201 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:56:07.228 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T12:56:07.254 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T12:56:07.279 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T12:56:07.345 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:56:13.239 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:56:13.239 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T12:56:13.240 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T12:56:13.241 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T12:56:13.242 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T12:56:13.243 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T12:56:13.244 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T12:56:13.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T12:56:13.246 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T12:56:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T12:56:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T12:56:13.249 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T12:56:13.250 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T12:56:13.251 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T12:56:13.252 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T12:56:13.253 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T12:56:13.254 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:56:13.254 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T12:56:13.254 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:56:13.254 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T12:56:13.254 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T12:56:13.255 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T12:56:13.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T12:56:13.257 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T12:56:13.258 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T12:56:16.288 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T12:56:16.288 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.289 INFO:teuthology.orchestra.run.smithi171.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.290 INFO:teuthology.orchestra.run.smithi171.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T12:56:16.291 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T12:56:16.291 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-16T12:56:16.291 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T12:56:16.291 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T12:56:16.291 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T12:56:16.291 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T12:56:16.291 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.292 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T12:56:16.293 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: jq-1.6-16.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T12:56:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T12:56:16.295 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T12:56:16.296 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T12:56:16.297 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T12:56:16.298 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T12:56:16.299 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T12:56:16.300 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T12:56:16.301 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T12:56:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T12:56:16.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T12:56:16.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T12:56:16.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T12:56:16.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T12:56:16.303 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T12:56:16.304 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T12:56:16.305 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T12:56:16.305 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T12:56:16.305 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T12:56:16.305 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T12:56:16.305 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T12:56:16.305 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:16.305 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-16T12:56:16.821 DEBUG:teuthology.parallel:result is None 2024-04-16T12:56:16.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:56:16.964 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T12:56:16.991 INFO:teuthology.orchestra.run.smithi106.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:56:16.991 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:56:16.992 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T12:56:16.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:56:17.146 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T12:56:17.170 INFO:teuthology.orchestra.run.smithi171.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:56:17.170 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:56:17.170 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T12:56:17.172 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T12:56:17.172 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:17.172 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T12:56:17.209 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:17.209 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T12:56:17.243 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T12:56:17.243 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:17.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T12:56:17.282 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T12:56:17.367 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:17.368 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T12:56:17.398 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T12:56:17.468 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T12:56:17.468 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:17.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T12:56:17.496 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T12:56:17.565 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:17.565 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T12:56:17.594 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T12:56:17.663 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T12:56:17.663 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:17.664 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T12:56:17.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T12:56:17.761 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:17.761 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T12:56:17.791 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T12:56:17.863 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T12:56:17.961 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-16T12:56:17.961 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-04-16T12:56:17.964 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-04-16T12:56:17.992 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-16T12:56:17.992 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T12:56:18.033 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T12:56:18.060 INFO:tasks.ceph:Creating extra log directories... 2024-04-16T12:56:18.061 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T12:56:18.100 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T12:56:18.135 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-16T12:56:18.135 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-16T12:56:18.135 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-16T12:56:18.135 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:18.135 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T12:56:18.182 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:18.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:18.330 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:18.330 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T12:56:18.346 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:18.462 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:18.496 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-16T12:56:18.496 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T12:56:18.496 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170', 'branch': 'wip-lusov-shared-log-segment', 'description': 'fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/centos_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell}', 'email': None, 'first_in_suite': False, 'job_id': '7658170', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-shared-log-segment'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-shared-log-segment', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2402, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'sleep_before_teardown': 0, 'subset': '111/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-shared-log-segment', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfAhReQBkvDER85Qt8aPzMXLGHjz5ewbRsrgVCMdqGCKXPmfvCoH3A5k9Wpy0MNCelYiVuB+XmYpqfk3E+lcB0=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPeCb8gfBXs8Y0kYyAno9Q+hoxzxmPb9dQLiTUnzBrSbC7gAX/hjVH8GhxcYhAd1wyVry9JJ28gkaqgFNCc2gj0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cephfs_shell']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_12:36:42', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T12:56:18.497 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T12:56:18.499 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T12:56:18.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T12:56:18.554 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T12:56:18.615 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:18.615 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T12:56:18.636 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T12:56:18.637 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-16 12:55:35.040219859 +0000 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-16 12:53:10.324790528 +0000 2024-04-16T12:56:18.694 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-16 12:53:10.324790528 +0000 2024-04-16T12:56:18.695 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-16 12:53:10.324790528 +0000 2024-04-16T12:56:18.695 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T12:56:18.759 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-16T12:56:18.759 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-16T12:56:18.759 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000204254 s, 2.5 MB/s 2024-04-16T12:56:18.760 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T12:56:18.817 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-04-16T12:56:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T12:56:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:18.874 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-16T12:56:18.875 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:18.875 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:18.875 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-16 12:55:35.041219837 +0000 2024-04-16T12:56:18.875 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-16 12:53:10.725782110 +0000 2024-04-16T12:56:18.875 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-16 12:53:10.725782110 +0000 2024-04-16T12:56:18.875 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-16 12:53:10.725782110 +0000 2024-04-16T12:56:18.875 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T12:56:18.941 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-16T12:56:18.941 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-16T12:56:18.941 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000187636 s, 2.7 MB/s 2024-04-16T12:56:18.942 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T12:56:18.999 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-16 12:55:35.041219837 +0000 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-16 12:53:11.076774741 +0000 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-16 12:53:11.076774741 +0000 2024-04-16T12:56:19.055 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-16 12:53:11.076774741 +0000 2024-04-16T12:56:19.056 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-16T12:56:19.122 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-16T12:56:19.122 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000192174 s, 2.7 MB/s 2024-04-16T12:56:19.124 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T12:56:19.181 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-16 12:55:35.041219837 +0000 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-16 12:53:11.428767352 +0000 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-16 12:53:11.428767352 +0000 2024-04-16T12:56:19.237 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-16 12:53:11.428767352 +0000 2024-04-16T12:56:19.238 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T12:56:19.304 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-16T12:56:19.304 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-16T12:56:19.304 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000189017 s, 2.7 MB/s 2024-04-16T12:56:19.305 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T12:56:19.362 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:19.362 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:19.362 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T12:56:19.380 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T12:56:19.380 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-04-16T12:56:19.437 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T12:56:19.437 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:19.437 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-16T12:56:19.437 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:19.437 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:19.437 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-16 12:56:07.679366818 +0000 2024-04-16T12:56:19.438 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-16 12:53:11.253961650 +0000 2024-04-16T12:56:19.438 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-16 12:53:11.253961650 +0000 2024-04-16T12:56:19.438 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-16 12:53:11.253961650 +0000 2024-04-16T12:56:19.438 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T12:56:19.506 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-16T12:56:19.507 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-16T12:56:19.507 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000269802 s, 1.9 MB/s 2024-04-16T12:56:19.508 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T12:56:19.567 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-04-16T12:56:19.624 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T12:56:19.624 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:19.624 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-16T12:56:19.624 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:19.624 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:19.624 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-16 12:56:07.680366800 +0000 2024-04-16T12:56:19.624 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-16 12:53:11.652954529 +0000 2024-04-16T12:56:19.625 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-16 12:53:11.652954529 +0000 2024-04-16T12:56:19.625 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-16 12:53:11.652954529 +0000 2024-04-16T12:56:19.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T12:56:19.692 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-16T12:56:19.692 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-16T12:56:19.692 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000179958 s, 2.8 MB/s 2024-04-16T12:56:19.693 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T12:56:19.750 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-16 12:56:07.680366800 +0000 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-16 12:53:12.045947514 +0000 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-16 12:53:12.045947514 +0000 2024-04-16T12:56:19.807 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-16 12:53:12.045947514 +0000 2024-04-16T12:56:19.808 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T12:56:19.875 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-16T12:56:19.875 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-16T12:56:19.875 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.00019448 s, 2.6 MB/s 2024-04-16T12:56:19.876 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T12:56:19.933 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-16 12:56:07.681366783 +0000 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-16 12:53:12.409941017 +0000 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-16 12:53:12.409941017 +0000 2024-04-16T12:56:19.990 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-16 12:53:12.409941017 +0000 2024-04-16T12:56:19.991 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T12:56:20.057 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-16T12:56:20.057 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-16T12:56:20.058 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000232856 s, 2.2 MB/s 2024-04-16T12:56:20.059 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T12:56:20.116 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:20.116 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T12:56:20.116 INFO:tasks.ceph:Generating config... 2024-04-16T12:56:20.117 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-16T12:56:20.118 INFO:tasks.ceph:[client] debug client = 20 2024-04-16T12:56:20.118 INFO:tasks.ceph:[client] debug ms = 1 2024-04-16T12:56:20.118 INFO:tasks.ceph:[client] pid file = 2024-04-16T12:56:20.118 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-16T12:56:20.118 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-16T12:56:20.118 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-16T12:56:20.118 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-16T12:56:20.118 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-16T12:56:20.118 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-16T12:56:20.118 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-16T12:56:20.118 INFO:tasks.ceph:[mds] mds debug zombie log segments = True 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-16T12:56:20.119 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-16T12:56:20.119 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-16T12:56:20.120 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-16T12:56:20.121 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-16T12:56:20.121 INFO:tasks.ceph:Setting up mon.a... 2024-04-16T12:56:20.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-16T12:56:20.185 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.keyring 2024-04-16T12:56:20.188 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-16T12:56:20.235 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T12:56:20.263 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.106'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2024-04-16T12:56:20.264 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.106,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-16T12:56:20.264 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:20.265 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T12:56:20.319 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.106 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:20.405 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:20.405 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid 2138f2ff-23aa-427d-a47c-cfcd7bf8d143 2024-04-16T12:56:20.405 INFO:teuthology.orchestra.run.smithi106.stdout:setting min_mon_release = quincy 2024-04-16T12:56:20.405 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2024-04-16T12:56:20.405 INFO:teuthology.orchestra.run.smithi106.stdout:fsid 2138f2ff-23aa-427d-a47c-cfcd7bf8d143 2024-04-16T12:56:20.405 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2024-04-16T12:56:20.404677+0000 2024-04-16T12:56:20.405 INFO:teuthology.orchestra.run.smithi106.stdout:created 2024-04-16T12:56:20.404677+0000 2024-04-16T12:56:20.406 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 17 (quincy) 2024-04-16T12:56:20.406 INFO:teuthology.orchestra.run.smithi106.stdout:election_strategy: 1 2024-04-16T12:56:20.406 INFO:teuthology.orchestra.run.smithi106.stdout:0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2024-04-16T12:56:20.406 INFO:teuthology.orchestra.run.smithi106.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-04-16T12:56:20.406 INFO:teuthology.orchestra.run.smithi106.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2024-04-16T12:56:20.406 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-16T12:56:20.407 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T12:56:20.422 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2138f2ff-23aa-427d-a47c-cfcd7bf8d143... 2024-04-16T12:56:20.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T12:56:20.465 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T12:56:20.515 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-16T12:56:20.515 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-16T12:56:20.515 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T12:56:20.515 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-16T12:56:20.515 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-16T12:56:20.516 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T12:56:20.517 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.106,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-04-16T12:56:20.518 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 2138f2ff-23aa-427d-a47c-cfcd7bf8d143 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-16T12:56:20.519 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug trim objects = true 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.520 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-04-16T12:56:20.521 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-16T12:56:20.522 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:56:20.523 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.524 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: mon down mkfs grace = 300 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-16T12:56:20.525 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-04-16T12:56:20.526 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug zombie log segments = True 2024-04-16T12:56:20.527 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-04-16T12:56:20.527 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-04-16T12:56:20.527 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-16T12:56:20.527 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-16T12:56:20.527 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-16T12:56:20.527 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-04-16T12:56:20.528 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-04-16T12:56:20.529 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.530 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.106,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 2138f2ff-23aa-427d-a47c-cfcd7bf8d143 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-04-16T12:56:20.531 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.532 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-04-16T12:56:20.533 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-04-16T12:56:20.534 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-16T12:56:20.535 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T12:56:20.536 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: mon down mkfs grace = 300 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T12:56:20.537 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds balancer = 20 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-16T12:56:20.538 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2024-04-16T12:56:20.539 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2024-04-16T12:56:20.539 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug zombie log segments = True 2024-04-16T12:56:20.539 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2024-04-16T12:56:20.539 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2024-04-16T12:56:20.539 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-04-16T12:56:20.539 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-04-16T12:56:20.539 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-04-16T12:56:20.541 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-16T12:56:20.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-16T12:56:20.639 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T12:56:20.640 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:20.640 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-16T12:56:20.655 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:20.655 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-16T12:56:20.711 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:56:20.711 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:20.711 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T12:56:20.711 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T12:56:20.793 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:20.793 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:20.849 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:56:20.849 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:20.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T12:56:20.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T12:56:20.893 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:20.893 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:20.949 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T12:56:20.950 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T12:56:20.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T12:56:21.007 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T12:56:21.010 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T12:56:21.074 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T12:56:21.076 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T12:56:21.076 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T12:56:21.134 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T12:56:21.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-16T12:56:21.164 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T12:56:21.222 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T12:56:21.224 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-16T12:56:21.253 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T12:56:21.254 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-16T12:56:21.299 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-16T12:56:21.315 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T12:56:21.315 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T12:56:21.315 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-16T12:56:21.343 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:21.343 INFO:tasks.ceph:role: osd.0 2024-04-16T12:56:21.343 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:56:21.343 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T12:56:21.419 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:21.419 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:21.419 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:21.420 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:21.420 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:21.420 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:21.420 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:21.420 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:21.420 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:21.420 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:21.919 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-16T12:56:21.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-16T12:56:21.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-16T12:56:22.050 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-16T12:56:22.084 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-16T12:56:22.153 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:22.153 INFO:tasks.ceph:role: osd.1 2024-04-16T12:56:22.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:56:22.153 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T12:56:22.229 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:22.229 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:22.229 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:22.229 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:22.229 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:22.230 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:22.230 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:22.230 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:22.230 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:22.230 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:22.699 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-16T12:56:22.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-16T12:56:22.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-16T12:56:22.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-16T12:56:22.826 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-16T12:56:22.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:22.895 INFO:tasks.ceph:role: osd.2 2024-04-16T12:56:22.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:56:22.895 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T12:56:22.972 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:22.972 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:22.972 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:22.972 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:22.973 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:22.973 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:22.973 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:22.973 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:22.973 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:22.973 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:23.477 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-16T12:56:23.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-16T12:56:23.479 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-16T12:56:23.629 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-16T12:56:23.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-16T12:56:23.736 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:23.736 INFO:tasks.ceph:role: osd.3 2024-04-16T12:56:23.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:56:23.736 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:23.813 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:24.325 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-16T12:56:24.327 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-16T12:56:24.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-16T12:56:24.429 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-16T12:56:24.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:24.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:24.577+0000 7f2a88b9a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-16T12:56:24.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:24.578+0000 7f2a88b9a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-16T12:56:24.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:24.578+0000 7f2a88b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T12:56:24.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:24.578+0000 7f2a88b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T12:56:24.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:24.578+0000 7f2a88b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T12:56:24.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:24.578+0000 7f2a88b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-16T12:56:27.428 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T12:56:27.458 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:27.546+0000 7f077381f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-16T12:56:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:27.547+0000 7f077381f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-16T12:56:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:27.547+0000 7f077381f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T12:56:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:27.547+0000 7f077381f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T12:56:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:27.547+0000 7f077381f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T12:56:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:27.547+0000 7f077381f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-16T12:56:30.401 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T12:56:30.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:30.522+0000 7fb40dd9e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-16T12:56:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:30.523+0000 7fb40dd9e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-16T12:56:30.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:30.523+0000 7fb40dd9e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T12:56:30.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:30.523+0000 7fb40dd9e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T12:56:30.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:30.523+0000 7fb40dd9e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T12:56:30.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:30.523+0000 7fb40dd9e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-16T12:56:33.372 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T12:56:33.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:33.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:33.496+0000 7f2366d6b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-16T12:56:33.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:33.496+0000 7f2366d6b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-16T12:56:33.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:33.496+0000 7f2366d6b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T12:56:33.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:33.496+0000 7f2366d6b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T12:56:33.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:33.496+0000 7f2366d6b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T12:56:33.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:33.497+0000 7f2366d6b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-16T12:56:36.359 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T12:56:36.395 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-16T12:56:36.431 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:36.431 INFO:tasks.ceph:role: osd.4 2024-04-16T12:56:36.431 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:56:36.431 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T12:56:36.510 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:36.510 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:36.511 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:37.014 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-16T12:56:37.016 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-16T12:56:37.017 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-16T12:56:37.135 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-16T12:56:37.170 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-16T12:56:37.239 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:37.239 INFO:tasks.ceph:role: osd.5 2024-04-16T12:56:37.239 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:56:37.240 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T12:56:37.317 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:37.317 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:37.317 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:37.317 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:37.318 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:37.318 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:37.318 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:37.318 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:37.318 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:37.318 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:37.775 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-16T12:56:37.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-16T12:56:37.777 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-16T12:56:37.869 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-16T12:56:37.902 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-16T12:56:37.971 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:37.971 INFO:tasks.ceph:role: osd.6 2024-04-16T12:56:37.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:56:37.971 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:38.048 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:38.542 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-16T12:56:38.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-16T12:56:38.544 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-16T12:56:38.682 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-16T12:56:38.715 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-16T12:56:38.784 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:56:38.784 INFO:tasks.ceph:role: osd.7 2024-04-16T12:56:38.784 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:56:38.784 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T12:56:38.862 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:56:38.862 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:56:38.862 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:56:38.862 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:56:38.862 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:56:38.862 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:56:38.862 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:56:38.863 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:56:38.863 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:56:38.863 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:56:39.394 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-16T12:56:39.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-16T12:56:39.396 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-16T12:56:39.534 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-16T12:56:39.574 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:39.675 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:39.673+0000 7f167cc1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-16T12:56:39.676 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:39.674+0000 7f167cc1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-16T12:56:39.676 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:39.674+0000 7f167cc1a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T12:56:39.676 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:39.674+0000 7f167cc1a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T12:56:39.676 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:39.674+0000 7f167cc1a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T12:56:39.676 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:39.674+0000 7f167cc1a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-16T12:56:42.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T12:56:42.556 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:42.649 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:42.647+0000 7f4736aa0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-16T12:56:42.649 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:42.648+0000 7f4736aa0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-16T12:56:42.649 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:42.648+0000 7f4736aa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T12:56:42.649 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:42.648+0000 7f4736aa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T12:56:42.649 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:42.648+0000 7f4736aa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T12:56:42.650 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:42.648+0000 7f4736aa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-16T12:56:45.494 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T12:56:45.526 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:45.618 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:45.616+0000 7f296ce11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-16T12:56:45.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:45.616+0000 7f296ce11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-16T12:56:45.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:45.616+0000 7f296ce11640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T12:56:45.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:45.616+0000 7f296ce11640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T12:56:45.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:45.616+0000 7f296ce11640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T12:56:45.619 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:45.617+0000 7f296ce11640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-16T12:56:48.463 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-16T12:56:48.493 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:48.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:48.501 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:48.584 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:48.582+0000 7fa5a8b8f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-16T12:56:48.584 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:48.582+0000 7fa5a8b8f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-16T12:56:48.584 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:48.582+0000 7fa5a8b8f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T12:56:48.584 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:48.582+0000 7fa5a8b8f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T12:56:48.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:48.582+0000 7fa5a8b8f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T12:56:48.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:48.583+0000 7fa5a8b8f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-16T12:56:51.430 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-16T12:56:51.462 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T12:56:51.462 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:51.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-16T12:56:51.496 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:51.496 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-16T12:56:51.567 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:51.567 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-16T12:56:51.638 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:51.638 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-16T12:56:51.707 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:51.708 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-16T12:56:51.777 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:51.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-16T12:56:51.846 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:51.846 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-16T12:56:51.881 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:51.881 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-16T12:56:51.953 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:51.953 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-16T12:56:52.024 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:52.024 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-16T12:56:52.094 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:52.094 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-16T12:56:52.167 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:52.167 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-16T12:56:52.237 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:52.237 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-16T12:56:52.255 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T12:56:52.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T12:56:52.298 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T12:56:52.328 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2024-04-16T12:56:52.329 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB1dR5mCXdvABAAd1gF5ZJ7ffvAuMuYSOgU5w== 2024-04-16T12:56:52.329 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-16T12:56:52.329 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB1dR5mz1f2BxAA3f8nm/56F5V8Wt3iid+4yQ== 2024-04-16T12:56:52.329 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-04-16T12:56:52.329 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB4dR5mu8qAIhAAty62qQB4B6og4DOdofDK/Q== 2024-04-16T12:56:52.329 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-04-16T12:56:52.329 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB7dR5mfQWmIBAAZboQex6qptr1wJQKCjiH8g== 2024-04-16T12:56:52.330 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-04-16T12:56:52.330 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB+dR5mTuM2HxAASSHEOp55yJBUATitrkzHaA== 2024-04-16T12:56:52.330 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-04-16T12:56:52.330 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCBdR5mfeK3HRAApKL2bdM55Cx2BICOXPuz3w== 2024-04-16T12:56:52.330 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB1dR5m6YRjBBAAi87cPlg+5jqLPNNGeT62cA== 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB1dR5mURo4DRAAQ+yjbn1JKrrJlU0XBrqU1w== 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCHdR5mk603KBAAm9jqGz2Ysg7izwLdhLgACQ== 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCKdR5m1HypJhAADpt6VMjjyTSDYXe/4Hwnlw== 2024-04-16T12:56:52.331 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2024-04-16T12:56:52.332 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCNdR5mGNHMJBAAfO6pcrlGRJXQBbHtuFRpHw== 2024-04-16T12:56:52.332 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2024-04-16T12:56:52.332 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCQdR5mUwXIIhAAnWjEHwhGh83uTa2gaeQZtQ== 2024-04-16T12:56:52.332 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-04-16T12:56:52.332 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB1dR5m+WbUERAAd0Ad0MV0D4YY+D2NE++aGQ== 2024-04-16T12:56:52.332 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-04-16T12:56:52.333 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB1dR5mCXdvABAAd1gF5ZJ7ffvAuMuYSOgU5w== 2024-04-16T12:56:52.333 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-04-16T12:56:52.333 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB1dR5mz1f2BxAA3f8nm/56F5V8Wt3iid+4yQ== 2024-04-16T12:56:52.333 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-04-16T12:56:52.333 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB4dR5mu8qAIhAAty62qQB4B6og4DOdofDK/Q== 2024-04-16T12:56:52.333 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-04-16T12:56:52.334 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB7dR5mfQWmIBAAZboQex6qptr1wJQKCjiH8g== 2024-04-16T12:56:52.334 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-04-16T12:56:52.334 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB+dR5mTuM2HxAASSHEOp55yJBUATitrkzHaA== 2024-04-16T12:56:52.334 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-04-16T12:56:52.334 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCBdR5mfeK3HRAApKL2bdM55Cx2BICOXPuz3w== 2024-04-16T12:56:52.334 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-04-16T12:56:52.335 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB1dR5m6YRjBBAAi87cPlg+5jqLPNNGeT62cA== 2024-04-16T12:56:52.335 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-04-16T12:56:52.335 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB1dR5mURo4DRAAQ+yjbn1JKrrJlU0XBrqU1w== 2024-04-16T12:56:52.335 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-04-16T12:56:52.335 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCHdR5mk603KBAAm9jqGz2Ysg7izwLdhLgACQ== 2024-04-16T12:56:52.335 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-04-16T12:56:52.336 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKdR5m1HypJhAADpt6VMjjyTSDYXe/4Hwnlw== 2024-04-16T12:56:52.336 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-04-16T12:56:52.336 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCNdR5mGNHMJBAAfO6pcrlGRJXQBbHtuFRpHw== 2024-04-16T12:56:52.336 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-04-16T12:56:52.336 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCQdR5mUwXIIhAAnWjEHwhGh83uTa2gaeQZtQ== 2024-04-16T12:56:52.336 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-04-16T12:56:52.337 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB1dR5m+WbUERAAd0Ad0MV0D4YY+D2NE++aGQ== 2024-04-16T12:56:52.337 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:56:52.371 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:56:52.427 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:56:52.430 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:56:52.487 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.490 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.546 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.550 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.607 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.660 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.663 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.717 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:56:52.719 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:56:52.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:56:52.775 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:56:52.832 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.834 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:52.948 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:53.001 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:53.004 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:56:53.058 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:56:53.060 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:56:53.116 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T12:56:53.116 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-16T12:56:53.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T12:56:53.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-16T12:56:53.272 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-16T12:56:53.301 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T12:56:53.402 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-16T12:56:53.430 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-16T12:56:53.499 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T12:56:53.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-16T12:56:53.626 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:53.628 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:56:53.682 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-16T12:56:53.682 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-16T12:56:53.682 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-16T12:56:53.684 INFO:tasks.ceph.mon.a:Started 2024-04-16T12:56:53.684 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-16T12:56:53.685 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-16T12:56:53.724 INFO:tasks.ceph.mon.b:Started 2024-04-16T12:56:53.725 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-16T12:56:53.725 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-16T12:56:53.728 INFO:tasks.ceph.mon.c:Started 2024-04-16T12:56:53.728 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-16T12:56:53.729 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-16T12:56:53.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-16T12:56:53.732 INFO:tasks.ceph.mgr.y:Started 2024-04-16T12:56:53.732 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-16T12:56:53.732 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-16T12:56:53.734 INFO:tasks.ceph.mgr.x:Started 2024-04-16T12:56:53.734 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T12:56:53.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd crush tunables default 2024-04-16T12:56:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.835+0000 7faac93f4640 1 Processor -- start 2024-04-16T12:56:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.835+0000 7faac93f4640 1 -- start start 2024-04-16T12:56:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac93f4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 0x7faac41480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac93f4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac40b5e80 con 0x7faac40bac70 2024-04-16T12:56:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac93f4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac4072ed0 con 0x7faac41485e0 2024-04-16T12:56:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac93f4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7faac40731b0 con 0x7faac4072850 2024-04-16T12:56:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac27fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 0x7faac41480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac2ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faac40bac70 0x7faac40737b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39682/0 (socket says 172.21.15.106:39682) 2024-04-16T12:56:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac27fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 0x7faac41480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55380/0 (socket says 172.21.15.106:55380) 2024-04-16T12:56:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac2ffd640 1 -- 172.21.15.106:0/2715244741 learned_addr learned my addr 172.21.15.106:0/2715244741 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:56:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac27fc640 1 -- 172.21.15.106:0/2715244741 >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 msgr2=0x7faac41480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:56:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac27fc640 1 -- 172.21.15.106:0/2715244741 >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 msgr2=0x7faac41480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:56:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac27fc640 1 --2- 172.21.15.106:0/2715244741 >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 0x7faac41480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:56:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:53.836+0000 7faac27fc640 1 --2- 172.21.15.106:0/2715244741 >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 0x7faac41480a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.006+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705632499 0 0) 0x7faac40b5e80 con 0x7faac40bac70 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.006+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaac003520 con 0x7faac40bac70 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660428282 0 0) 0x7faac4072ed0 con 0x7faac41485e0 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faac40b5e80 con 0x7faac41485e0 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3135742352 0 0) 0x7faac40b5e80 con 0x7faac41485e0 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 msgr2=0x7faac41480a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 --2- 172.21.15.106:0/2715244741 >> v2:172.21.15.106:3300/0 conn(0x7faac4072850 0x7faac41480a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 >> v1:172.21.15.106:6789/0 conn(0x7faac40bac70 legacy=0x7faac40737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac40b0b20 con 0x7faac41485e0 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7faabc0019f0 con 0x7faac41485e0 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 >> v1:172.21.15.171:6789/0 conn(0x7faac41485e0 legacy=0x7faac4152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaac003b40 0x7faaac003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac004800 0x7faaac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faaac0052e0 0x7faaac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faac40731b0 con 0x7faaac003b40 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faaac00c230 con 0x7faaac004800 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faaac00c430 con 0x7faaac0052e0 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac2ffd640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaac003b40 0x7faaac003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac27fc640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac004800 0x7faaac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac37fe640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faaac0052e0 0x7faaac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac2ffd640 1 -- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faaac0052e0 msgr2=0x7faaac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac2ffd640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faaac0052e0 0x7faaac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.007+0000 7faac2ffd640 1 -- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac004800 msgr2=0x7faaac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.008+0000 7faac2ffd640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac004800 0x7faaac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.008+0000 7faac2ffd640 1 -- 172.21.15.106:0/2715244741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac40b5e80 con 0x7faaac003b40 2024-04-16T12:56:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.008+0000 7faac37fe640 1 -- 172.21.15.106:0/2715244741 reap_dead start 2024-04-16T12:56:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.008+0000 7faac2ffd640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaac003b40 0x7faaac003f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faab4007fd0 tx=0x7faaac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dad5acdc99409a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.009+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4037070 con 0x7faaac003b40 2024-04-16T12:56:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.009+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab40048a0 con 0x7faaac003b40 2024-04-16T12:56:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.009+0000 7faac1ffb640 1 -- 172.21.15.106:0/2715244741 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4001610 con 0x7faaac003b40 2024-04-16T12:56:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.010+0000 7faac93f4640 1 -- 172.21.15.106:0/2715244741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaac003b40 msgr2=0x7faaac003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.010+0000 7faac93f4640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaac003b40 0x7faaac003f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faab4007fd0 tx=0x7faaac005830 comp rx=0 tx=0).stop 2024-04-16T12:56:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.010+0000 7faac93f4640 1 -- 172.21.15.106:0/2715244741 shutdown_connections 2024-04-16T12:56:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.010+0000 7faac93f4640 1 --2- 172.21.15.106:0/2715244741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaac003b40 0x7faaac003f40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.010+0000 7faac93f4640 1 -- 172.21.15.106:0/2715244741 >> 172.21.15.106:0/2715244741 conn(0x7faac406d200 msgr2=0x7faac40ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.010+0000 7faac93f4640 1 -- 172.21.15.106:0/2715244741 shutdown_connections 2024-04-16T12:56:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.010+0000 7faac93f4640 1 -- 172.21.15.106:0/2715244741 wait complete. 2024-04-16T12:56:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.011+0000 7faac93f4640 1 Processor -- start 2024-04-16T12:56:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.012+0000 7faac93f4640 1 -- start start 2024-04-16T12:56:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.012+0000 7faac93f4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac003b40 0x7faac40b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.012+0000 7faac93f4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faac40b3250 0x7faac40aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac93f4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40af430 0x7faac41e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac93f4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faac40bb050 con 0x7faac40b3250 2024-04-16T12:56:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac93f4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faac40b1380 con 0x7faaac003b40 2024-04-16T12:56:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac93f4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faac40718f0 con 0x7faac40af430 2024-04-16T12:56:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faac40b3250 0x7faac40aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faac40b3250 0x7faac40aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55396/0 (socket says 172.21.15.106:55396) 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 -- 172.21.15.106:0/632242135 learned_addr learned my addr 172.21.15.106:0/632242135 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac37fe640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40af430 0x7faac41e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac2ffd640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac003b40 0x7faac40b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 -- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40af430 msgr2=0x7faac41e0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40af430 0x7faac41e0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 -- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac003b40 msgr2=0x7faac40b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac003b40 0x7faac40b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 -- 172.21.15.106:0/632242135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac40b44f0 con 0x7faac40b3250 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac27fc640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faac40b3250 0x7faac40aeef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faab8006c00 tx=0x7faab8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faaab7fe640 1 -- 172.21.15.106:0/632242135 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab801a020 con 0x7faac40b3250 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faaab7fe640 1 -- 172.21.15.106:0/632242135 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab800e9c0 con 0x7faac40b3250 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faaab7fe640 1 -- 172.21.15.106:0/632242135 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab800ed90 con 0x7faac40b3250 2024-04-16T12:56:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac40af890 con 0x7faac40b3250 2024-04-16T12:56:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.013+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac40b0510 con 0x7faac40b3250 2024-04-16T12:56:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.014+0000 7faaab7fe640 1 -- 172.21.15.106:0/632242135 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faab801d020 con 0x7faac40b3250 2024-04-16T12:56:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.014+0000 7faaab7fe640 1 -- 172.21.15.106:0/632242135 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faab80148b0 con 0x7faac40b3250 2024-04-16T12:56:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.015+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac40691a0 con 0x7faac40b3250 2024-04-16T12:56:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.017+0000 7faaab7fe640 1 -- 172.21.15.106:0/632242135 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faab8024020 con 0x7faac40b3250 2024-04-16T12:56:54.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.083+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7faac41d05a0 con 0x7faac40b3250 2024-04-16T12:56:54.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.084+0000 7faaab7fe640 1 -- 172.21.15.106:0/632242135 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7faab8014ab0 con 0x7faac40b3250 2024-04-16T12:56:54.086 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2024-04-16T12:56:54.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faac40b3250 msgr2=0x7faac40aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faac40b3250 0x7faac40aeef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faab8006c00 tx=0x7faab8010d20 comp rx=0 tx=0).stop 2024-04-16T12:56:54.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 shutdown_connections 2024-04-16T12:56:54.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40af430 0x7faac41e0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faac40b3250 0x7faac40aeef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 --2- 172.21.15.106:0/632242135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faaac003b40 0x7faac40b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 >> 172.21.15.106:0/632242135 conn(0x7faac406d200 msgr2=0x7faac413e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:54.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 shutdown_connections 2024-04-16T12:56:54.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:54.085+0000 7faac93f4640 1 -- 172.21.15.106:0/632242135 wait complete. 2024-04-16T12:56:54.098 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T12:56:54.098 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-16T12:56:54.098 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:54.098 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-16T12:56:54.126 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:54.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-16T12:56:54.194 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:54.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-16T12:56:54.263 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:56:54.263 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-16T12:56:54.332 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:54.332 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-16T12:56:54.360 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:54.360 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-16T12:56:54.429 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:54.429 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-16T12:56:54.474 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:54.473+0000 7f641c20d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T12:56:54.487 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:54.486+0000 7f69af840040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T12:56:54.497 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-16T12:56:54.497 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-16T12:56:54.532 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:54.530+0000 7f641c20d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T12:56:54.542 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:54.540+0000 7f69af840040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T12:56:54.561 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 350b0aaf-4d05-4145-9603-a86306f60a02 0 2024-04-16T12:56:54.704 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.702+0000 7feab573d640 1 Processor -- start 2024-04-16T12:56:54.704 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.702+0000 7feab573d640 1 -- start start 2024-04-16T12:56:54.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feab573d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feab006e5d0 0x7feab006d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feab573d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab00b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feab573d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab00b2710 con 0x7feab014b4b0 2024-04-16T12:56:54.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feab573d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7feab00b23c0 con 0x7feab006e5d0 2024-04-16T12:56:54.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feab573d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feab00b7210 con 0x7feab00b5220 2024-04-16T12:56:54.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feaaf7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7feab014b4b0 0x7feab014b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52256/0 (socket says 172.21.15.171:52256) 2024-04-16T12:56:54.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feaaf7fe640 1 -- 172.21.15.171:0/2683296213 learned_addr learned my addr 172.21.15.171:0/2683296213 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feaa7fff640 1 --2- 172.21.15.171:0/2683296213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab00b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.703+0000 7feaaeffd640 1 --2- 172.21.15.171:0/2683296213 >> v2:172.21.15.106:3300/0 conn(0x7feab006e5d0 0x7feab006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.704+0000 7feaae7fc640 1 -- 172.21.15.171:0/2683296213 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781048716 0 0) 0x7feab00b2710 con 0x7feab014b4b0 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.704+0000 7feaae7fc640 1 -- 172.21.15.171:0/2683296213 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea9c003520 con 0x7feab014b4b0 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.704+0000 7feaa7fff640 1 -- 172.21.15.171:0/2683296213 >> v2:172.21.15.106:3300/0 conn(0x7feab006e5d0 msgr2=0x7feab006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.704+0000 7feaa7fff640 1 --2- 172.21.15.171:0/2683296213 >> v2:172.21.15.106:3300/0 conn(0x7feab006e5d0 0x7feab006d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.704+0000 7feaa7fff640 1 -- 172.21.15.171:0/2683296213 >> v1:172.21.15.171:6789/0 conn(0x7feab014b4b0 legacy=0x7feab014b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.704+0000 7feaa7fff640 1 -- 172.21.15.171:0/2683296213 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab00b76a0 con 0x7feab00b5220 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.704+0000 7feaa7fff640 1 --2- 172.21.15.171:0/2683296213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab00b5640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea980097a0 tx=0x7fea9802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797c7c55d19db7b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feaae7fc640 1 -- 172.21.15.171:0/2683296213 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98039070 con 0x7feab00b5220 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feaae7fc640 1 -- 172.21.15.171:0/2683296213 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea980316f0 con 0x7feab00b5220 2024-04-16T12:56:54.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feaae7fc640 1 -- 172.21.15.171:0/2683296213 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98031ac0 con 0x7feab00b5220 2024-04-16T12:56:54.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 -- 172.21.15.171:0/2683296213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 msgr2=0x7feab00b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 --2- 172.21.15.171:0/2683296213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab00b5640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea980097a0 tx=0x7fea9802b790 comp rx=0 tx=0).stop 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 -- 172.21.15.171:0/2683296213 shutdown_connections 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 --2- 172.21.15.171:0/2683296213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab00b5640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 --2- 172.21.15.171:0/2683296213 >> v2:172.21.15.106:3300/0 conn(0x7feab006e5d0 0x7feab006d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 -- 172.21.15.171:0/2683296213 >> 172.21.15.171:0/2683296213 conn(0x7feab00bb4e0 msgr2=0x7feab00bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 -- 172.21.15.171:0/2683296213 shutdown_connections 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.705+0000 7feab573d640 1 -- 172.21.15.171:0/2683296213 wait complete. 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.706+0000 7feab573d640 1 Processor -- start 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.706+0000 7feab573d640 1 -- start start 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feab573d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feab006e5d0 0x7feab01413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feab573d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab01dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feab573d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab014b4b0 0x7feab0147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feab573d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feab006ced0 con 0x7feab014b4b0 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feab573d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feab006cbf0 con 0x7feab006e5d0 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feab573d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feab006d760 con 0x7feab00b5220 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaaeffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feab006e5d0 0x7feab01413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab01dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaaeffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feab006e5d0 0x7feab01413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56282/0 (socket says 172.21.15.171:56282) 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab01dd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:50716/0 (socket says 172.21.15.171:50716) 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaaeffd640 1 -- 172.21.15.171:0/75045047 learned_addr learned my addr 172.21.15.171:0/75045047 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaaf7fe640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab014b4b0 0x7feab0147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaa7fff640 1 -- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feab006e5d0 msgr2=0x7feab01413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaa7fff640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feab006e5d0 0x7feab01413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaa7fff640 1 -- 172.21.15.171:0/75045047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab014b4b0 msgr2=0x7feab0147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaa7fff640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab014b4b0 0x7feab0147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaa7fff640 1 -- 172.21.15.171:0/75045047 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab01d0d00 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.707+0000 7feaaeffd640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feab006e5d0 0x7feab01413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feaa7fff640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab01dd0a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea98033000 tx=0x7fea980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feaa77fe640 1 -- 172.21.15.171:0/75045047 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98043070 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feaa77fe640 1 -- 172.21.15.171:0/75045047 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea980346a0 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab0148c20 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feaa77fe640 1 -- 172.21.15.171:0/75045047 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98039040 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feab01e0a70 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feaa77fe640 1 -- 172.21.15.171:0/75045047 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea9803c070 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.708+0000 7feaa77fe640 1 -- 172.21.15.171:0/75045047 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fea9803e6d0 con 0x7feab00b5220 2024-04-16T12:56:54.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.709+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab00691a0 con 0x7feab00b5220 2024-04-16T12:56:54.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.711+0000 7feaa77fe640 1 -- 172.21.15.171:0/75045047 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fea98031640 con 0x7feab00b5220 2024-04-16T12:56:54.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.783+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "350b0aaf-4d05-4145-9603-a86306f60a02", "id": 0} v 0) -- 0x7feab01dd5e0 con 0x7feab00b5220 2024-04-16T12:56:54.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.786+0000 7feaa77fe640 1 -- 172.21.15.171:0/75045047 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "350b0aaf-4d05-4145-9603-a86306f60a02", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fea98034a90 con 0x7feab00b5220 2024-04-16T12:56:54.788 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-04-16T12:56:54.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 msgr2=0x7feab01dd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab01dd0a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea98033000 tx=0x7fea980046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 shutdown_connections 2024-04-16T12:56:54.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab014b4b0 0x7feab0147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feab00b5220 0x7feab01dd0a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 --2- 172.21.15.171:0/75045047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feab006e5d0 0x7feab01413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 >> 172.21.15.171:0/75045047 conn(0x7feab00bb4e0 msgr2=0x7feab0072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:54.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 shutdown_connections 2024-04-16T12:56:54.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.787+0000 7feab573d640 1 -- 172.21.15.171:0/75045047 wait complete. 2024-04-16T12:56:54.799 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 734e17f6-54f4-4693-87ef-12b52e98f242 1 2024-04-16T12:56:54.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.900+0000 7fed43028640 1 Processor -- start 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.900+0000 7fed43028640 1 -- start start 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.900+0000 7fed43028640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c13eeb0 0x7fed3c072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.900+0000 7fed43028640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c0730f0 con 0x7fed3c072d10 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.900+0000 7fed43028640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c0714b0 con 0x7fed3c0baf70 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed43028640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c071790 con 0x7fed3c13eeb0 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed415c5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c13eeb0 0x7fed3c072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed3bfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fed3c0baf70 0x7fed3c13e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52262/0 (socket says 172.21.15.171:52262) 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed3bfff640 1 -- 172.21.15.171:0/2517815480 learned_addr learned my addr 172.21.15.171:0/2517815480 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed3b7fe640 1 -- 172.21.15.171:0/2517815480 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491710098 0 0) 0x7fed3c0714b0 con 0x7fed3c0baf70 2024-04-16T12:56:54.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed415c5640 1 -- 172.21.15.171:0/2517815480 >> v1:172.21.15.171:6789/0 conn(0x7fed3c0baf70 legacy=0x7fed3c13e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed415c5640 1 -- 172.21.15.171:0/2517815480 >> v1:172.21.15.106:6789/0 conn(0x7fed3c072d10 legacy=0x7fed3c0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.901+0000 7fed415c5640 1 -- 172.21.15.171:0/2517815480 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c071dd0 con 0x7fed3c13eeb0 2024-04-16T12:56:54.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.902+0000 7fed415c5640 1 --2- 172.21.15.171:0/2517815480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c13eeb0 0x7fed3c072190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed34009dc0 tx=0x7fed3402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63372c1fe9b3a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:54.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.902+0000 7fed3b7fe640 1 -- 172.21.15.171:0/2517815480 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34039070 con 0x7fed3c13eeb0 2024-04-16T12:56:54.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.902+0000 7fed3b7fe640 1 -- 172.21.15.171:0/2517815480 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3402cc40 con 0x7fed3c13eeb0 2024-04-16T12:56:54.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.902+0000 7fed3b7fe640 1 -- 172.21.15.171:0/2517815480 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34034440 con 0x7fed3c13eeb0 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.902+0000 7fed43028640 1 -- 172.21.15.171:0/2517815480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c13eeb0 msgr2=0x7fed3c072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.902+0000 7fed43028640 1 --2- 172.21.15.171:0/2517815480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c13eeb0 0x7fed3c072190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed34009dc0 tx=0x7fed3402be90 comp rx=0 tx=0).stop 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.903+0000 7fed43028640 1 -- 172.21.15.171:0/2517815480 shutdown_connections 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.903+0000 7fed43028640 1 --2- 172.21.15.171:0/2517815480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c13eeb0 0x7fed3c072190 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.903+0000 7fed43028640 1 -- 172.21.15.171:0/2517815480 >> 172.21.15.171:0/2517815480 conn(0x7fed3c06d200 msgr2=0x7fed3c0ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.903+0000 7fed43028640 1 -- 172.21.15.171:0/2517815480 shutdown_connections 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.903+0000 7fed43028640 1 -- 172.21.15.171:0/2517815480 wait complete. 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 Processor -- start 2024-04-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 -- start start 2024-04-16T12:56:54.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c072d10 0x7fed3c148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed3c13eeb0 0x7fed3c1d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed3c1dd760 0x7fed3c1dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:54.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c06bb30 con 0x7fed3c13eeb0 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c06b9b0 con 0x7fed3c1dd760 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed43028640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c06bcb0 con 0x7fed3c072d10 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.904+0000 7fed40dc4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c072d10 0x7fed3c148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c072d10 0x7fed3c148440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:50732/0 (socket says 172.21.15.171:50732) 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed415c5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed3c1dd760 0x7fed3c1dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 -- 172.21.15.171:0/1463260355 learned_addr learned my addr 172.21.15.171:0/1463260355 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed3bfff640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed3c13eeb0 0x7fed3c1d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 -- 172.21.15.171:0/1463260355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed3c1dd760 msgr2=0x7fed3c1dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed3c1dd760 0x7fed3c1dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 -- 172.21.15.171:0/1463260355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed3c13eeb0 msgr2=0x7fed3c1d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed3c13eeb0 0x7fed3c1d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 -- 172.21.15.171:0/1463260355 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c146fc0 con 0x7fed3c072d10 2024-04-16T12:56:54.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed40dc4640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c072d10 0x7fed3c148440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c480 tx=0x7fed3000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed397fa640 1 -- 172.21.15.171:0/1463260355 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300052d0 con 0x7fed3c072d10 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed397fa640 1 -- 172.21.15.171:0/1463260355 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30005470 con 0x7fed3c072d10 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed397fa640 1 -- 172.21.15.171:0/1463260355 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30012870 con 0x7fed3c072d10 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c147c40 con 0x7fed3c072d10 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c13b4b0 con 0x7fed3c072d10 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed397fa640 1 -- 172.21.15.171:0/1463260355 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed30012a10 con 0x7fed3c072d10 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.905+0000 7fed397fa640 1 -- 172.21.15.171:0/1463260355 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fed3001b570 con 0x7fed3c072d10 2024-04-16T12:56:54.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.906+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c0691a0 con 0x7fed3c072d10 2024-04-16T12:56:54.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.908+0000 7fed397fa640 1 -- 172.21.15.171:0/1463260355 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fed300035f0 con 0x7fed3c072d10 2024-04-16T12:56:54.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.979+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "734e17f6-54f4-4693-87ef-12b52e98f242", "id": 1} v 0) -- 0x7fed3c075670 con 0x7fed3c072d10 2024-04-16T12:56:54.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.982+0000 7fed397fa640 1 -- 172.21.15.171:0/1463260355 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "734e17f6-54f4-4693-87ef-12b52e98f242", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fed300037d0 con 0x7fed3c072d10 2024-04-16T12:56:54.984 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-04-16T12:56:54.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c072d10 msgr2=0x7fed3c148440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:54.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c072d10 0x7fed3c148440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c480 tx=0x7fed3000c940 comp rx=0 tx=0).stop 2024-04-16T12:56:54.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 shutdown_connections 2024-04-16T12:56:54.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed3c1dd760 0x7fed3c1dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed3c13eeb0 0x7fed3c1d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 --2- 172.21.15.171:0/1463260355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed3c072d10 0x7fed3c148440 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:54.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 >> 172.21.15.171:0/1463260355 conn(0x7fed3c06d200 msgr2=0x7fed3c0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:54.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 shutdown_connections 2024-04-16T12:56:54.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:54.983+0000 7fed43028640 1 -- 172.21.15.171:0/1463260355 wait complete. 2024-04-16T12:56:54.996 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 1033de9d-c8cf-4a1a-a586-0bde8aa0b091 2 2024-04-16T12:56:55.065 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.064+0000 7f69af840040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T12:56:55.092 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.090+0000 7f641c20d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T12:56:55.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.098+0000 7f282c915640 1 Processor -- start 2024-04-16T12:56:55.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.098+0000 7f282c915640 1 -- start start 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282c915640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f28280bad00 0x7f28280b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282c915640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282814e420 0x7f2828150810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282c915640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28280bb0e0 con 0x7f28280b1880 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282c915640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f28280b4210 con 0x7f28280bad00 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282c915640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28280b44f0 con 0x7f282814e420 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282659c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f28280bad00 0x7f28280b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f2826d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282814e420 0x7f2828150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282659c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f28280bad00 0x7f28280b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56302/0 (socket says 172.21.15.171:56302) 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282659c640 1 -- 172.21.15.171:0/1060882575 learned_addr learned my addr 172.21.15.171:0/1060882575 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282659c640 1 -- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282814e420 msgr2=0x7f2828150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282659c640 1 --2- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282814e420 0x7f2828150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282659c640 1 -- 172.21.15.171:0/1060882575 >> v1:172.21.15.106:6789/0 conn(0x7f28280b1880 legacy=0x7f282813fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f282659c640 1 -- 172.21.15.171:0/1060882575 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28280b47d0 con 0x7f28280bad00 2024-04-16T12:56:55.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.099+0000 7f2826d9d640 1 --2- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282814e420 0x7f2828150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:55.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.100+0000 7f282659c640 1 --2- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28280bad00 0x7f28280b5460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f281802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69826020b6e21f5d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.100+0000 7f2825d9b640 1 -- 172.21.15.171:0/1060882575 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818035020 con 0x7f28280bad00 2024-04-16T12:56:55.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.100+0000 7f2825d9b640 1 -- 172.21.15.171:0/1060882575 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2818031640 con 0x7f28280bad00 2024-04-16T12:56:55.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.100+0000 7f2825d9b640 1 -- 172.21.15.171:0/1060882575 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281802d040 con 0x7f28280bad00 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 -- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28280bad00 msgr2=0x7f28280b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 --2- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28280bad00 0x7f28280b5460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f281802b8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 -- 172.21.15.171:0/1060882575 shutdown_connections 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 --2- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282814e420 0x7f2828150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 --2- 172.21.15.171:0/1060882575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28280bad00 0x7f28280b5460 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 -- 172.21.15.171:0/1060882575 >> 172.21.15.171:0/1060882575 conn(0x7f282806d200 msgr2=0x7f28280ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 -- 172.21.15.171:0/1060882575 shutdown_connections 2024-04-16T12:56:55.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.101+0000 7f282c915640 1 -- 172.21.15.171:0/1060882575 wait complete. 2024-04-16T12:56:55.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.103+0000 7f282c915640 1 Processor -- start 2024-04-16T12:56:55.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.103+0000 7f282c915640 1 -- start start 2024-04-16T12:56:55.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f282c915640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28280b1880 0x7f2828131120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f282c915640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28280bad00 0x7f28281dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f282c915640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282814e420 0x7f28281dc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f282c915640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f28280b31e0 con 0x7f28280b1880 2024-04-16T12:56:55.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f282c915640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28280b3060 con 0x7f282814e420 2024-04-16T12:56:55.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f282c915640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2828140150 con 0x7f28280bad00 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f2826d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282814e420 0x7f28281dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f281ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28280bad00 0x7f28281dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f2826d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282814e420 0x7f28281dc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56310/0 (socket says 172.21.15.171:56310) 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f2826d9d640 1 -- 172.21.15.171:0/3494289911 learned_addr learned my addr 172.21.15.171:0/3494289911 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.104+0000 7f282659c640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28280b1880 0x7f2828131120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f2826d9d640 1 -- 172.21.15.171:0/3494289911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28280bad00 msgr2=0x7f28281dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f2826d9d640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28280bad00 0x7f28281dbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f2826d9d640 1 -- 172.21.15.171:0/3494289911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28280b1880 msgr2=0x7f2828131120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f2826d9d640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28280b1880 0x7f2828131120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f2826d9d640 1 -- 172.21.15.171:0/3494289911 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28280ba360 con 0x7f282814e420 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f2826d9d640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282814e420 0x7f28281dc200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f282000efb0 tx=0x7f282000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f281effd640 1 -- 172.21.15.171:0/3494289911 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820018020 con 0x7f282814e420 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f281effd640 1 -- 172.21.15.171:0/3494289911 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820014480 con 0x7f282814e420 2024-04-16T12:56:55.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f281effd640 1 -- 172.21.15.171:0/3494289911 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820014850 con 0x7f282814e420 2024-04-16T12:56:55.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28281319f0 con 0x7f282814e420 2024-04-16T12:56:55.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2828130400 con 0x7f282814e420 2024-04-16T12:56:55.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f281effd640 1 -- 172.21.15.171:0/3494289911 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2820005d10 con 0x7f282814e420 2024-04-16T12:56:55.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.105+0000 7f281effd640 1 -- 172.21.15.171:0/3494289911 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f282001ddb0 con 0x7f282814e420 2024-04-16T12:56:55.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.106+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282806e2f0 con 0x7f282814e420 2024-04-16T12:56:55.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.108+0000 7f281effd640 1 -- 172.21.15.171:0/3494289911 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2820022030 con 0x7f282814e420 2024-04-16T12:56:55.120 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.118+0000 7f69af840040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T12:56:55.150 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.149+0000 7f641c20d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T12:56:55.164 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.163+0000 7f69af840040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T12:56:55.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.179+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1033de9d-c8cf-4a1a-a586-0bde8aa0b091", "id": 2} v 0) -- 0x7f28280691a0 con 0x7f282814e420 2024-04-16T12:56:55.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.182+0000 7f281effd640 1 -- 172.21.15.171:0/3494289911 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1033de9d-c8cf-4a1a-a586-0bde8aa0b091", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2820010040 con 0x7f282814e420 2024-04-16T12:56:55.184 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282814e420 msgr2=0x7f28281dc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282814e420 0x7f28281dc200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f282000efb0 tx=0x7f282000c490 comp rx=0 tx=0).stop 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 shutdown_connections 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282814e420 0x7f28281dc200 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28280bad00 0x7f28281dbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 --2- 172.21.15.171:0/3494289911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28280b1880 0x7f2828131120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 >> 172.21.15.171:0/3494289911 conn(0x7f282806d200 msgr2=0x7f28280b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 shutdown_connections 2024-04-16T12:56:55.186 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.183+0000 7f282c915640 1 -- 172.21.15.171:0/3494289911 wait complete. 2024-04-16T12:56:55.195 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 2b630c2e-866a-4281-96f5-7f4ffc204c0b 3 2024-04-16T12:56:55.198 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.195+0000 7f641c20d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T12:56:55.218 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.217+0000 7f69af840040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T12:56:55.255 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.253+0000 7f641c20d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T12:56:55.261 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.260+0000 7f69af840040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T12:56:55.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7face51c8640 1 Processor -- start 2024-04-16T12:56:55.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7face51c8640 1 -- start start 2024-04-16T12:56:55.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7face51c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7face51c8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7face006e880 0x7face014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7face51c8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face00b7e10 con 0x7face006e420 2024-04-16T12:56:55.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7face51c8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7face00b59c0 con 0x7face006e880 2024-04-16T12:56:55.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7face51c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7face006dcb0 con 0x7face00b55e0 2024-04-16T12:56:55.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.297+0000 7facded9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.298+0000 7facded9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face006d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:50752/0 (socket says 172.21.15.171:50752) 2024-04-16T12:56:55.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.298+0000 7facded9d640 1 -- 172.21.15.171:0/2687450665 learned_addr learned my addr 172.21.15.171:0/2687450665 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.298+0000 7facdf59e640 1 --2- 172.21.15.171:0/2687450665 >> v2:172.21.15.106:3300/0 conn(0x7face006e880 0x7face014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.298+0000 7facded9d640 1 -- 172.21.15.171:0/2687450665 >> v2:172.21.15.106:3300/0 conn(0x7face006e880 msgr2=0x7face014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:55.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.298+0000 7facded9d640 1 --2- 172.21.15.171:0/2687450665 >> v2:172.21.15.106:3300/0 conn(0x7face006e880 0x7face014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.298+0000 7facded9d640 1 -- 172.21.15.171:0/2687450665 >> v1:172.21.15.106:6789/0 conn(0x7face006e420 legacy=0x7face014b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.298+0000 7facded9d640 1 -- 172.21.15.171:0/2687450665 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face006df90 con 0x7face00b55e0 2024-04-16T12:56:55.302 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.298+0000 7f641c20d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T12:56:55.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7facded9d640 1 --2- 172.21.15.171:0/2687450665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face006d650 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7facd0009870 tx=0x7facd002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755b48f3a2b97182 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7facddd9b640 1 -- 172.21.15.171:0/2687450665 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0035020 con 0x7face00b55e0 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7facddd9b640 1 -- 172.21.15.171:0/2687450665 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd0031640 con 0x7face00b55e0 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7facddd9b640 1 -- 172.21.15.171:0/2687450665 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd002d040 con 0x7face00b55e0 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 -- 172.21.15.171:0/2687450665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 msgr2=0x7face006d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 --2- 172.21.15.171:0/2687450665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face006d650 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7facd0009870 tx=0x7facd002b8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 -- 172.21.15.171:0/2687450665 shutdown_connections 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 --2- 172.21.15.171:0/2687450665 >> v2:172.21.15.106:3300/0 conn(0x7face006e880 0x7face014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 --2- 172.21.15.171:0/2687450665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face006d650 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 -- 172.21.15.171:0/2687450665 >> 172.21.15.171:0/2687450665 conn(0x7face0068080 msgr2=0x7face00bb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.307 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 -- 172.21.15.171:0/2687450665 shutdown_connections 2024-04-16T12:56:55.307 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.299+0000 7face51c8640 1 -- 172.21.15.171:0/2687450665 wait complete. 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 Processor -- start 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 -- start start 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face006e420 0x7face00af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7face006e880 0x7face01ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face01e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7face014c210 con 0x7face006e880 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7face0072400 con 0x7face006e420 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7face51c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7face014c390 con 0x7face00b55e0 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7facdf59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face01e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7facded9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face006e420 0x7face00af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7facdf59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face01e0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:50756/0 (socket says 172.21.15.171:50756) 2024-04-16T12:56:55.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7facdf59e640 1 -- 172.21.15.171:0/117098182 learned_addr learned my addr 172.21.15.171:0/117098182 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.301+0000 7facde59c640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7face006e880 0x7face01ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facded9d640 1 -- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 msgr2=0x7face01e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facded9d640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face01e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facded9d640 1 -- 172.21.15.171:0/117098182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7face006e880 msgr2=0x7face01ddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facded9d640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7face006e880 0x7face01ddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facded9d640 1 -- 172.21.15.171:0/117098182 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face00b1a30 con 0x7face006e420 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facdf59e640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face01e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facde59c640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7face006e880 0x7face01ddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facded9d640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face006e420 0x7face00af660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7facd0033000 tx=0x7facd00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facc77fe640 1 -- 172.21.15.171:0/117098182 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0040070 con 0x7face006e420 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facc77fe640 1 -- 172.21.15.171:0/117098182 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00399f0 con 0x7face006e420 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facc77fe640 1 -- 172.21.15.171:0/117098182 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0035040 con 0x7face006e420 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face01dd7e0 con 0x7face006e420 2024-04-16T12:56:55.309 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face0145d50 con 0x7face006e420 2024-04-16T12:56:55.310 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.302+0000 7facc77fe640 1 -- 172.21.15.171:0/117098182 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7facd004b060 con 0x7face006e420 2024-04-16T12:56:55.310 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.303+0000 7facc77fe640 1 -- 172.21.15.171:0/117098182 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7facd003ac40 con 0x7face006e420 2024-04-16T12:56:55.310 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.303+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face00691a0 con 0x7face006e420 2024-04-16T12:56:55.310 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.305+0000 7facc77fe640 1 -- 172.21.15.171:0/117098182 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7facd003a7b0 con 0x7face006e420 2024-04-16T12:56:55.378 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.376+0000 7f69af840040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T12:56:55.393 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.391+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2b630c2e-866a-4281-96f5-7f4ffc204c0b", "id": 3} v 0) -- 0x7face006ecd0 con 0x7face006e420 2024-04-16T12:56:55.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.394+0000 7facc77fe640 1 -- 172.21.15.171:0/117098182 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b630c2e-866a-4281-96f5-7f4ffc204c0b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7facd004d400 con 0x7face006e420 2024-04-16T12:56:55.396 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face006e420 msgr2=0x7face00af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face006e420 0x7face00af660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7facd0033000 tx=0x7facd00046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 shutdown_connections 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face00b55e0 0x7face01e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7face006e880 0x7face01ddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 --2- 172.21.15.171:0/117098182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face006e420 0x7face00af660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 >> 172.21.15.171:0/117098182 conn(0x7face0068080 msgr2=0x7face00b8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 shutdown_connections 2024-04-16T12:56:55.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.395+0000 7face51c8640 1 -- 172.21.15.171:0/117098182 wait complete. 2024-04-16T12:56:55.407 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 3dda85a1-e4c0-472e-a2d6-fa73e663fb02 4 2024-04-16T12:56:55.436 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.434+0000 7f641c20d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T12:56:55.448 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.446+0000 7f69af840040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T12:56:55.493 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.492+0000 7f69af840040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T12:56:55.510 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.508+0000 7f641c20d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T12:56:55.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.510+0000 7f92604fb640 1 Processor -- start 2024-04-16T12:56:55.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.510+0000 7f92604fb640 1 -- start start 2024-04-16T12:56:55.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f92604fb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9258147b00 0x7f9258147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f92604fb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f925813e010 0x7f925813e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f92604fb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9258071260 con 0x7f92580725e0 2024-04-16T12:56:55.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f92604fb640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9258072e10 con 0x7f9258147b00 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f92604fb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9258148580 con 0x7f925813e010 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f925ea98640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f925813e010 0x7f925813e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f925e297640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9258147b00 0x7f9258147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f925da96640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f92580725e0 0x7f9258071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52274/0 (socket says 172.21.15.171:52274) 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.511+0000 7f925da96640 1 -- 172.21.15.171:0/255532230 learned_addr learned my addr 172.21.15.171:0/255532230 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.512+0000 7f925ea98640 1 -- 172.21.15.171:0/255532230 >> v2:172.21.15.171:3300/0 conn(0x7f9258147b00 msgr2=0x7f9258147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.512+0000 7f925ea98640 1 --2- 172.21.15.171:0/255532230 >> v2:172.21.15.171:3300/0 conn(0x7f9258147b00 0x7f9258147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.512+0000 7f925ea98640 1 -- 172.21.15.171:0/255532230 >> v1:172.21.15.171:6789/0 conn(0x7f92580725e0 legacy=0x7f9258071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.512+0000 7f925ea98640 1 -- 172.21.15.171:0/255532230 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925813ea00 con 0x7f925813e010 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.512+0000 7f925d295640 1 -- 172.21.15.171:0/255532230 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628902532 0 0) 0x7f9258071260 con 0x7f92580725e0 2024-04-16T12:56:55.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.512+0000 7f925e297640 1 --2- 172.21.15.171:0/255532230 >> v2:172.21.15.171:3300/0 conn(0x7f9258147b00 0x7f9258147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:55.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.513+0000 7f925ea98640 1 --2- 172.21.15.171:0/255532230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f925813e010 0x7f925813e4c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f925000aea0 tx=0x7f925002cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3679ac6382637a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.513+0000 7f925d295640 1 -- 172.21.15.171:0/255532230 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925002db40 con 0x7f925813e010 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.513+0000 7f925d295640 1 -- 172.21.15.171:0/255532230 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925002dce0 con 0x7f925813e010 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.513+0000 7f925d295640 1 -- 172.21.15.171:0/255532230 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250008660 con 0x7f925813e010 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 -- 172.21.15.171:0/255532230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f925813e010 msgr2=0x7f925813e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 --2- 172.21.15.171:0/255532230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f925813e010 0x7f925813e4c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f925000aea0 tx=0x7f925002cfa0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 -- 172.21.15.171:0/255532230 shutdown_connections 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 --2- 172.21.15.171:0/255532230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f925813e010 0x7f925813e4c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 --2- 172.21.15.171:0/255532230 >> v2:172.21.15.171:3300/0 conn(0x7f9258147b00 0x7f9258147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 -- 172.21.15.171:0/255532230 >> 172.21.15.171:0/255532230 conn(0x7f92580b7a80 msgr2=0x7f92580b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 -- 172.21.15.171:0/255532230 shutdown_connections 2024-04-16T12:56:55.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.514+0000 7f92604fb640 1 -- 172.21.15.171:0/255532230 wait complete. 2024-04-16T12:56:55.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 Processor -- start 2024-04-16T12:56:55.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 -- start start 2024-04-16T12:56:55.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92580725e0 0x7f9258144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f925813e010 0x7f92581db180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9258147b00 0x7f92580b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9258071ff0 con 0x7f92580725e0 2024-04-16T12:56:55.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9258071e70 con 0x7f925813e010 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.515+0000 7f92604fb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9258067760 con 0x7f9258147b00 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f925813e010 0x7f92581db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f925813e010 0x7f92581db180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56344/0 (socket says 172.21.15.171:56344) 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 -- 172.21.15.171:0/2630152103 learned_addr learned my addr 172.21.15.171:0/2630152103 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925ea98640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9258147b00 0x7f92580b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925e297640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92580725e0 0x7f9258144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 -- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9258147b00 msgr2=0x7f92580b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9258147b00 0x7f92580b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 -- 172.21.15.171:0/2630152103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92580725e0 msgr2=0x7f9258144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92580725e0 0x7f9258144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 -- 172.21.15.171:0/2630152103 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92580b3060 con 0x7f925813e010 2024-04-16T12:56:55.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f925da96640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f925813e010 0x7f92581db180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f925400c4b0 tx=0x7f925400c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f924effd640 1 -- 172.21.15.171:0/2630152103 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254018070 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f924effd640 1 -- 172.21.15.171:0/2630152103 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9254007500 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9258140440 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f924effd640 1 -- 172.21.15.171:0/2630152103 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254004a20 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9258140160 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f924effd640 1 -- 172.21.15.171:0/2630152103 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f925401b070 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.516+0000 7f924effd640 1 -- 172.21.15.171:0/2630152103 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9254012910 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.517+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92580691a0 con 0x7f925813e010 2024-04-16T12:56:55.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.519+0000 7f924effd640 1 -- 172.21.15.171:0/2630152103 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9254012c30 con 0x7f925813e010 2024-04-16T12:56:55.545 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.544+0000 7f69af840040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T12:56:55.560 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.558+0000 7f641c20d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T12:56:55.591 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.590+0000 7f69af840040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T12:56:55.593 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.592+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3dda85a1-e4c0-472e-a2d6-fa73e663fb02", "id": 4} v 0) -- 0x7f925813c2d0 con 0x7f925813e010 2024-04-16T12:56:55.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.597+0000 7f924effd640 1 -- 172.21.15.171:0/2630152103 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3dda85a1-e4c0-472e-a2d6-fa73e663fb02", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9254004c10 con 0x7f925813e010 2024-04-16T12:56:55.599 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-04-16T12:56:55.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f925813e010 msgr2=0x7f92581db180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f925813e010 0x7f92581db180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f925400c4b0 tx=0x7f925400c970 comp rx=0 tx=0).stop 2024-04-16T12:56:55.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 shutdown_connections 2024-04-16T12:56:55.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9258147b00 0x7f92580b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f925813e010 0x7f92581db180 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 --2- 172.21.15.171:0/2630152103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92580725e0 0x7f9258144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 >> 172.21.15.171:0/2630152103 conn(0x7f92580b7a80 msgr2=0x7f925806e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.598+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 shutdown_connections 2024-04-16T12:56:55.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.599+0000 7f92604fb640 1 -- 172.21.15.171:0/2630152103 wait complete. 2024-04-16T12:56:55.610 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 84208a16-4fc5-4ad0-b917-9d52fbd79cea 5 2024-04-16T12:56:55.616 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.615+0000 7f641c20d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T12:56:55.667 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:55.665+0000 7f641c20d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T12:56:55.719 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46e44e640 1 Processor -- start 2024-04-16T12:56:55.719 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46e44e640 1 -- start start 2024-04-16T12:56:55.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46e44e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd4680bad00 0x7fd4680b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46e44e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd4680b1880 0x7fd46813fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46e44e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4680bb0e0 con 0x7fd46813ff80 2024-04-16T12:56:55.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46e44e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd4680b4210 con 0x7fd4680b1880 2024-04-16T12:56:55.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46e44e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd4680b44f0 con 0x7fd4680bad00 2024-04-16T12:56:55.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd467fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd4680bad00 0x7fd4680b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46c9eb640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd46813ff80 0x7fd46806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52278/0 (socket says 172.21.15.171:52278) 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd46c9eb640 1 -- 172.21.15.171:0/2815883534 learned_addr learned my addr 172.21.15.171:0/2815883534 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.718+0000 7fd467fff640 1 --2- 172.21.15.171:0/2815883534 >> v2:172.21.15.171:3300/0 conn(0x7fd4680bad00 0x7fd4680b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56356/0 (socket says 172.21.15.171:56356) 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.719+0000 7fd4677fe640 1 --2- 172.21.15.171:0/2815883534 >> v2:172.21.15.106:3300/0 conn(0x7fd4680b1880 0x7fd46813fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.719+0000 7fd467fff640 1 -- 172.21.15.171:0/2815883534 >> v2:172.21.15.106:3300/0 conn(0x7fd4680b1880 msgr2=0x7fd46813fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.719+0000 7fd467fff640 1 --2- 172.21.15.171:0/2815883534 >> v2:172.21.15.106:3300/0 conn(0x7fd4680b1880 0x7fd46813fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.719+0000 7fd467fff640 1 -- 172.21.15.171:0/2815883534 >> v1:172.21.15.171:6789/0 conn(0x7fd46813ff80 legacy=0x7fd46806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.719+0000 7fd467fff640 1 -- 172.21.15.171:0/2815883534 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4680b47d0 con 0x7fd4680bad00 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.719+0000 7fd4677fe640 1 --2- 172.21.15.171:0/2815883534 >> v2:172.21.15.106:3300/0 conn(0x7fd4680b1880 0x7fd46813fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.719+0000 7fd467fff640 1 --2- 172.21.15.171:0/2815883534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680bad00 0x7fd4680b5460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd46806c9f0 tx=0x7fd45802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb66181d89dd7227 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd466ffd640 1 -- 172.21.15.171:0/2815883534 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580315a0 con 0x7fd4680bad00 2024-04-16T12:56:55.723 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd466ffd640 1 -- 172.21.15.171:0/2815883534 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd458037070 con 0x7fd4680bad00 2024-04-16T12:56:55.723 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd466ffd640 1 -- 172.21.15.171:0/2815883534 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458031960 con 0x7fd4680bad00 2024-04-16T12:56:55.726 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 -- 172.21.15.171:0/2815883534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680bad00 msgr2=0x7fd4680b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.726 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 --2- 172.21.15.171:0/2815883534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680bad00 0x7fd4680b5460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd46806c9f0 tx=0x7fd45802b840 comp rx=0 tx=0).stop 2024-04-16T12:56:55.726 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 -- 172.21.15.171:0/2815883534 shutdown_connections 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 --2- 172.21.15.171:0/2815883534 >> v2:172.21.15.106:3300/0 conn(0x7fd4680b1880 0x7fd46813fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 --2- 172.21.15.171:0/2815883534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680bad00 0x7fd4680b5460 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 -- 172.21.15.171:0/2815883534 >> 172.21.15.171:0/2815883534 conn(0x7fd46806d200 msgr2=0x7fd4680ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 -- 172.21.15.171:0/2815883534 shutdown_connections 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.720+0000 7fd46e44e640 1 -- 172.21.15.171:0/2815883534 wait complete. 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.721+0000 7fd46e44e640 1 Processor -- start 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46e44e640 1 -- start start 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46e44e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4680b1880 0x7fd46813d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46e44e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4680bad00 0x7fd468072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46e44e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd46813ff80 0x7fd4681417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46e44e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd4680b31e0 con 0x7fd4680bad00 2024-04-16T12:56:55.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46e44e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4680b3060 con 0x7fd46813ff80 2024-04-16T12:56:55.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46e44e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4680b59a0 con 0x7fd4680b1880 2024-04-16T12:56:55.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd467fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4680b1880 0x7fd46813d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd46c9eb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd46813ff80 0x7fd4681417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd467fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4680b1880 0x7fd46813d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:50780/0 (socket says 172.21.15.171:50780) 2024-04-16T12:56:55.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd467fff640 1 -- 172.21.15.171:0/2615767380 learned_addr learned my addr 172.21.15.171:0/2615767380 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.722+0000 7fd4677fe640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4680bad00 0x7fd468072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46c9eb640 1 -- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4680b1880 msgr2=0x7fd46813d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46c9eb640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4680b1880 0x7fd46813d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46c9eb640 1 -- 172.21.15.171:0/2615767380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4680bad00 msgr2=0x7fd468072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46c9eb640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4680bad00 0x7fd468072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46c9eb640 1 -- 172.21.15.171:0/2615767380 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd468140a50 con 0x7fd46813ff80 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd467fff640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4680b1880 0x7fd46813d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46c9eb640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd46813ff80 0x7fd4681417a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd46000caa0 tx=0x7fd46000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd464ff9640 1 -- 172.21.15.171:0/2615767380 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460017070 con 0x7fd46813ff80 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd464ff9640 1 -- 172.21.15.171:0/2615767380 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46000ab40 con 0x7fd46813ff80 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd468142980 con 0x7fd46813ff80 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd464ff9640 1 -- 172.21.15.171:0/2615767380 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460012400 con 0x7fd46813ff80 2024-04-16T12:56:55.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46813f040 con 0x7fd46813ff80 2024-04-16T12:56:55.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd464ff9640 1 -- 172.21.15.171:0/2615767380 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd46001a070 con 0x7fd46813ff80 2024-04-16T12:56:55.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.723+0000 7fd464ff9640 1 -- 172.21.15.171:0/2615767380 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd46001cc40 con 0x7fd46813ff80 2024-04-16T12:56:55.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.724+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd468140c20 con 0x7fd46813ff80 2024-04-16T12:56:55.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.726+0000 7fd464ff9640 1 -- 172.21.15.171:0/2615767380 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd46001c6c0 con 0x7fd46813ff80 2024-04-16T12:56:55.800 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.799+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84208a16-4fc5-4ad0-b917-9d52fbd79cea", "id": 5} v 0) -- 0x7fd4680691a0 con 0x7fd46813ff80 2024-04-16T12:56:55.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.804+0000 7fd464ff9640 1 -- 172.21.15.171:0/2615767380 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84208a16-4fc5-4ad0-b917-9d52fbd79cea", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd46001c9d0 con 0x7fd46813ff80 2024-04-16T12:56:55.805 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-04-16T12:56:55.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd46813ff80 msgr2=0x7fd4681417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd46813ff80 0x7fd4681417a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd46000caa0 tx=0x7fd46000cf60 comp rx=0 tx=0).stop 2024-04-16T12:56:55.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 shutdown_connections 2024-04-16T12:56:55.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd46813ff80 0x7fd4681417a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4680bad00 0x7fd468072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 --2- 172.21.15.171:0/2615767380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4680b1880 0x7fd46813d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 >> 172.21.15.171:0/2615767380 conn(0x7fd46806d200 msgr2=0x7fd4680b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 shutdown_connections 2024-04-16T12:56:55.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.805+0000 7fd46e44e640 1 -- 172.21.15.171:0/2615767380 wait complete. 2024-04-16T12:56:55.817 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 2913d7c6-baa0-47c1-b909-369d2b637a4d 6 2024-04-16T12:56:55.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.918+0000 7f8b8441b640 1 Processor -- start 2024-04-16T12:56:55.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.918+0000 7f8b8441b640 1 -- start start 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b8441b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b5450 0x7f8b7c0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b8441b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8b7c140200 0x7f8b7c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b8441b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7c0b7530 con 0x7f8b7c0b4510 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b8441b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8b7c0b6410 con 0x7f8b7c140200 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b8441b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c0b5830 con 0x7f8b7c0b5450 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b829b8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8b7c140200 0x7f8b7c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b821b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b5450 0x7f8b7c0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b829b8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8b7c140200 0x7f8b7c0b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56374/0 (socket says 172.21.15.171:56374) 2024-04-16T12:56:55.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b829b8640 1 -- 172.21.15.171:0/3539069544 learned_addr learned my addr 172.21.15.171:0/3539069544 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b819b6640 1 --1- 172.21.15.171:0/3539069544 >> v1:172.21.15.171:6789/0 conn(0x7f8b7c0b4510 0x7f8b7c13faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52294/0 (socket says 172.21.15.171:52294) 2024-04-16T12:56:55.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b829b8640 1 -- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b5450 msgr2=0x7f8b7c0b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:55.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b829b8640 1 --2- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b5450 0x7f8b7c0b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b829b8640 1 -- 172.21.15.171:0/3539069544 >> v1:172.21.15.171:6789/0 conn(0x7f8b7c0b4510 legacy=0x7f8b7c13faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b829b8640 1 -- 172.21.15.171:0/3539069544 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c0b6660 con 0x7f8b7c140200 2024-04-16T12:56:55.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.919+0000 7f8b821b7640 1 --2- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b5450 0x7f8b7c0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.920+0000 7f8b829b8640 1 --2- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c0b4970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009e50 tx=0x7f8b7402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c59c9035bd106b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.920+0000 7f8b811b5640 1 -- 172.21.15.171:0/3539069544 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7402ca70 con 0x7f8b7c140200 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.920+0000 7f8b811b5640 1 -- 172.21.15.171:0/3539069544 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7402cc10 con 0x7f8b7c140200 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.920+0000 7f8b811b5640 1 -- 172.21.15.171:0/3539069544 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b740343f0 con 0x7f8b7c140200 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 -- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 msgr2=0x7f8b7c0b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 --2- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c0b4970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009e50 tx=0x7f8b7402bed0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 -- 172.21.15.171:0/3539069544 shutdown_connections 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 --2- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c0b4970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 --2- 172.21.15.171:0/3539069544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b5450 0x7f8b7c0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 -- 172.21.15.171:0/3539069544 >> 172.21.15.171:0/3539069544 conn(0x7f8b7c068120 msgr2=0x7f8b7c0b8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 -- 172.21.15.171:0/3539069544 shutdown_connections 2024-04-16T12:56:55.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.921+0000 7f8b8441b640 1 -- 172.21.15.171:0/3539069544 wait complete. 2024-04-16T12:56:55.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.922+0000 7f8b8441b640 1 Processor -- start 2024-04-16T12:56:55.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.922+0000 7f8b8441b640 1 -- start start 2024-04-16T12:56:55.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b8441b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b4510 0x7f8b7c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b8441b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b7c0b5450 0x7f8b7c140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b8441b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c1de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b8441b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c0b7c90 con 0x7f8b7c0b5450 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b8441b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c0b6c20 con 0x7f8b7c140200 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b8441b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c150610 con 0x7f8b7c0b4510 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b829b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c1de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b4510 0x7f8b7c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b4510 0x7f8b7c1423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:50812/0 (socket says 172.21.15.171:50812) 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b829b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c1de6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56382/0 (socket says 172.21.15.171:56382) 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 -- 172.21.15.171:0/1617250141 learned_addr learned my addr 172.21.15.171:0/1617250141 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b819b6640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b7c0b5450 0x7f8b7c140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 -- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 msgr2=0x7f8b7c1de6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c1de6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 -- 172.21.15.171:0/1617250141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b7c0b5450 msgr2=0x7f8b7c140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:55.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b7c0b5450 0x7f8b7c140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b821b7640 1 -- 172.21.15.171:0/1617250141 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c1437a0 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b829b8640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c1de6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.923+0000 7f8b819b6640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b7c0b5450 0x7f8b7c140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b821b7640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b4510 0x7f8b7c1423a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800ebe0 tx=0x7f8b7800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b72ffd640 1 -- 172.21.15.171:0/1617250141 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78017070 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b72ffd640 1 -- 172.21.15.171:0/1617250141 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7800cc30 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b72ffd640 1 -- 172.21.15.171:0/1617250141 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78013470 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c141e80 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c141610 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b72ffd640 1 -- 172.21.15.171:0/1617250141 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8b7801a070 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.924+0000 7f8b72ffd640 1 -- 172.21.15.171:0/1617250141 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8b7801ca90 con 0x7f8b7c0b4510 2024-04-16T12:56:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.925+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7c0691a0 con 0x7f8b7c0b4510 2024-04-16T12:56:55.930 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.927+0000 7f8b72ffd640 1 -- 172.21.15.171:0/1617250141 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8b7801c4a0 con 0x7f8b7c0b4510 2024-04-16T12:56:55.972 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:55.971+0000 7f69af840040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T12:56:56.000 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:55.999+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2913d7c6-baa0-47c1-b909-369d2b637a4d", "id": 6} v 0) -- 0x7f8b7c0b2680 con 0x7f8b7c0b4510 2024-04-16T12:56:56.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.004+0000 7f8b72ffd640 1 -- 172.21.15.171:0/1617250141 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2913d7c6-baa0-47c1-b909-369d2b637a4d", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8b7801c680 con 0x7f8b7c0b4510 2024-04-16T12:56:56.005 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b4510 msgr2=0x7f8b7c1423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b4510 0x7f8b7c1423a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800ebe0 tx=0x7f8b7800c520 comp rx=0 tx=0).stop 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 shutdown_connections 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b7c140200 0x7f8b7c1de6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b7c0b5450 0x7f8b7c140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 --2- 172.21.15.171:0/1617250141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b7c0b4510 0x7f8b7c1423a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 >> 172.21.15.171:0/1617250141 conn(0x7f8b7c068120 msgr2=0x7f8b7c074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 shutdown_connections 2024-04-16T12:56:56.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.005+0000 7f8b8441b640 1 -- 172.21.15.171:0/1617250141 wait complete. 2024-04-16T12:56:56.017 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new c243b03a-53b4-410b-9c30-50aa6401582e 7 2024-04-16T12:56:56.072 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.071+0000 7f641c20d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T12:56:56.109 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.107+0000 7f69af840040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T12:56:56.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.120+0000 7f5622a69640 1 Processor -- start 2024-04-16T12:56:56.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.120+0000 7f5622a69640 1 -- start start 2024-04-16T12:56:56.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.120+0000 7f5622a69640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f561c073390 0x7f561c153600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.120+0000 7f5622a69640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561c067db0 con 0x7f561c0679d0 2024-04-16T12:56:56.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.120+0000 7f5622a69640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561c06e9b0 con 0x7f561c072f00 2024-04-16T12:56:56.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.120+0000 7f5622a69640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f561c06ec70 con 0x7f561c073390 2024-04-16T12:56:56.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.121+0000 7f561bfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f561c072f00 0x7f561c141b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52308/0 (socket says 172.21.15.171:52308) 2024-04-16T12:56:56.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.121+0000 7f5621006640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f561c073390 0x7f561c153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.121+0000 7f561bfff640 1 -- 172.21.15.171:0/371704631 learned_addr learned my addr 172.21.15.171:0/371704631 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-16T12:56:56.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.121+0000 7f5621006640 1 -- 172.21.15.171:0/371704631 >> v1:172.21.15.171:6789/0 conn(0x7f561c072f00 legacy=0x7f561c141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.121+0000 7f5621006640 1 -- 172.21.15.171:0/371704631 >> v1:172.21.15.106:6789/0 conn(0x7f561c0679d0 legacy=0x7f561c071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.121+0000 7f5621006640 1 -- 172.21.15.171:0/371704631 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c06ef50 con 0x7f561c073390 2024-04-16T12:56:56.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.122+0000 7f5621006640 1 --2- 172.21.15.171:0/371704631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c073390 0x7f561c153600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5614009d90 tx=0x7f561402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65dbd09c6d4c1377 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.122+0000 7f561b7fe640 1 -- 172.21.15.171:0/371704631 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614039070 con 0x7f561c073390 2024-04-16T12:56:56.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.122+0000 7f561b7fe640 1 -- 172.21.15.171:0/371704631 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561402cbd0 con 0x7f561c073390 2024-04-16T12:56:56.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.122+0000 7f561b7fe640 1 -- 172.21.15.171:0/371704631 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614034440 con 0x7f561c073390 2024-04-16T12:56:56.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.123+0000 7f5622a69640 1 -- 172.21.15.171:0/371704631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c073390 msgr2=0x7f561c153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.123+0000 7f5622a69640 1 --2- 172.21.15.171:0/371704631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c073390 0x7f561c153600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5614009d90 tx=0x7f561402be20 comp rx=0 tx=0).stop 2024-04-16T12:56:56.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.123+0000 7f5622a69640 1 -- 172.21.15.171:0/371704631 shutdown_connections 2024-04-16T12:56:56.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.123+0000 7f5622a69640 1 --2- 172.21.15.171:0/371704631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c073390 0x7f561c153600 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.123+0000 7f5622a69640 1 -- 172.21.15.171:0/371704631 >> 172.21.15.171:0/371704631 conn(0x7f561c0b7a80 msgr2=0x7f561c0b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.123+0000 7f5622a69640 1 -- 172.21.15.171:0/371704631 shutdown_connections 2024-04-16T12:56:56.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.123+0000 7f5622a69640 1 -- 172.21.15.171:0/371704631 wait complete. 2024-04-16T12:56:56.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.124+0000 7f5622a69640 1 Processor -- start 2024-04-16T12:56:56.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.124+0000 7f5622a69640 1 -- start start 2024-04-16T12:56:56.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5622a69640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c0679d0 0x7f561c0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5622a69640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c072f00 0x7f561c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5622a69640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f561c073390 0x7f561c1ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5622a69640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f561c070f10 con 0x7f561c072f00 2024-04-16T12:56:56.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5622a69640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f561c070d90 con 0x7f561c0679d0 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5622a69640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f561c1422a0 con 0x7f561c073390 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c0679d0 0x7f561c0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c0679d0 0x7f561c0b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56390/0 (socket says 172.21.15.171:56390) 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 -- 172.21.15.171:0/3709442067 learned_addr learned my addr 172.21.15.171:0/3709442067 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5621006640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f561c073390 0x7f561c1ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f561bfff640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c072f00 0x7f561c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 -- 172.21.15.171:0/3709442067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f561c073390 msgr2=0x7f561c1ddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f561c073390 0x7f561c1ddb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 -- 172.21.15.171:0/3709442067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c072f00 msgr2=0x7f561c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c072f00 0x7f561c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 -- 172.21.15.171:0/3709442067 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c0b38e0 con 0x7f561c0679d0 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5620805640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c0679d0 0x7f561c0b11f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f561000c400 tx=0x7f561000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f56197fa640 1 -- 172.21.15.171:0/3709442067 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56100052d0 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f56197fa640 1 -- 172.21.15.171:0/3709442067 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5610005490 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f56197fa640 1 -- 172.21.15.171:0/3709442067 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610007260 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.125+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561c0b3170 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.126+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561c0b0680 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.126+0000 7f56197fa640 1 -- 172.21.15.171:0/3709442067 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5610007400 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.126+0000 7f56197fa640 1 -- 172.21.15.171:0/3709442067 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f5610011bf0 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.126+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561c0b3ab0 con 0x7f561c0679d0 2024-04-16T12:56:56.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.128+0000 7f56197fa640 1 -- 172.21.15.171:0/3709442067 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f56100035f0 con 0x7f561c0679d0 2024-04-16T12:56:56.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.201+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c243b03a-53b4-410b-9c30-50aa6401582e", "id": 7} v 0) -- 0x7f561c0691a0 con 0x7f561c0679d0 2024-04-16T12:56:56.210 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.209+0000 7f56197fa640 1 -- 172.21.15.171:0/3709442067 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c243b03a-53b4-410b-9c30-50aa6401582e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f5610003a50 con 0x7f561c0679d0 2024-04-16T12:56:56.210 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c0679d0 msgr2=0x7f561c0b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c0679d0 0x7f561c0b11f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f561000c400 tx=0x7f561000c8c0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 shutdown_connections 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f561c073390 0x7f561c1ddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c072f00 0x7f561c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 --2- 172.21.15.171:0/3709442067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f561c0679d0 0x7f561c0b11f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 >> 172.21.15.171:0/3709442067 conn(0x7f561c0b7a80 msgr2=0x7f561c0b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 shutdown_connections 2024-04-16T12:56:56.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-16T12:56:56.210+0000 7f5622a69640 1 -- 172.21.15.171:0/3709442067 wait complete. 2024-04-16T12:56:56.216 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.214+0000 7f641c20d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T12:56:56.222 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-16T12:56:56.223 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-16T12:56:56.225 INFO:tasks.ceph.osd.0:Started 2024-04-16T12:56:56.225 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-16T12:56:56.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-16T12:56:56.228 INFO:tasks.ceph.osd.1:Started 2024-04-16T12:56:56.228 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-16T12:56:56.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-16T12:56:56.229 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.227+0000 7f69af840040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T12:56:56.231 INFO:tasks.ceph.osd.2:Started 2024-04-16T12:56:56.231 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-16T12:56:56.231 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-16T12:56:56.233 INFO:tasks.ceph.osd.3:Started 2024-04-16T12:56:56.233 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-16T12:56:56.233 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-16T12:56:56.235 INFO:tasks.ceph.osd.4:Started 2024-04-16T12:56:56.236 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-16T12:56:56.236 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-16T12:56:56.238 INFO:tasks.ceph.osd.5:Started 2024-04-16T12:56:56.238 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-16T12:56:56.238 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-16T12:56:56.240 INFO:tasks.ceph.osd.6:Started 2024-04-16T12:56:56.240 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-16T12:56:56.240 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-16T12:56:56.242 INFO:tasks.ceph.osd.7:Started 2024-04-16T12:56:56.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:56.289 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.287+0000 7f69af840040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T12:56:56.352 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.350+0000 7f641c20d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.376+0000 7f17d3559640 1 Processor -- start 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d3559640 1 -- start start 2024-04-16T12:56:56.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d3559640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d3559640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17cc148640 0x7f17cc0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d3559640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17cc148b70 con 0x7f17cc1481c0 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d3559640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f17cc0b4bd0 con 0x7f17cc148640 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d3559640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17cc0b4eb0 con 0x7f17cc0b63a0 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d0af4640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f17cc1481c0 0x7f17cc1418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39698/0 (socket says 172.21.15.106:39698) 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d0af4640 1 -- 172.21.15.106:0/4087910997 learned_addr learned my addr 172.21.15.106:0/4087910997 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.377+0000 7f17d1af6640 1 --2- 172.21.15.106:0/4087910997 >> v2:172.21.15.106:3300/0 conn(0x7f17cc148640 0x7f17cc0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.378+0000 7f17d12f5640 1 --2- 172.21.15.106:0/4087910997 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.378+0000 7f17c3fff640 1 -- 172.21.15.106:0/4087910997 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862657461 0 0) 0x7f17cc148b70 con 0x7f17cc1481c0 2024-04-16T12:56:56.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.378+0000 7f17c3fff640 1 -- 172.21.15.106:0/4087910997 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17b8003520 con 0x7f17cc1481c0 2024-04-16T12:56:56.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.378+0000 7f17d1af6640 1 -- 172.21.15.106:0/4087910997 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 msgr2=0x7f17cc0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:56.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.378+0000 7f17d1af6640 1 --2- 172.21.15.106:0/4087910997 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.378+0000 7f17d1af6640 1 -- 172.21.15.106:0/4087910997 >> v1:172.21.15.106:6789/0 conn(0x7f17cc1481c0 legacy=0x7f17cc1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.378+0000 7f17d1af6640 1 -- 172.21.15.106:0/4087910997 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc141fb0 con 0x7f17cc148640 2024-04-16T12:56:56.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d1af6640 1 --2- 172.21.15.106:0/4087910997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc148640 0x7f17cc0b53d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009d90 tx=0x7f17c402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9427b75f29c1d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17c3fff640 1 -- 172.21.15.106:0/4087910997 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4039070 con 0x7f17cc148640 2024-04-16T12:56:56.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17c3fff640 1 -- 172.21.15.106:0/4087910997 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c402cbc0 con 0x7f17cc148640 2024-04-16T12:56:56.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17c3fff640 1 -- 172.21.15.106:0/4087910997 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4034440 con 0x7f17cc148640 2024-04-16T12:56:56.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 -- 172.21.15.106:0/4087910997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc148640 msgr2=0x7f17cc0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 --2- 172.21.15.106:0/4087910997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc148640 0x7f17cc0b53d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009d90 tx=0x7f17c402be10 comp rx=0 tx=0).stop 2024-04-16T12:56:56.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 -- 172.21.15.106:0/4087910997 shutdown_connections 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 --2- 172.21.15.106:0/4087910997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc148640 0x7f17cc0b53d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 --2- 172.21.15.106:0/4087910997 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 -- 172.21.15.106:0/4087910997 >> 172.21.15.106:0/4087910997 conn(0x7f17cc068080 msgr2=0x7f17cc0bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 -- 172.21.15.106:0/4087910997 shutdown_connections 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.379+0000 7f17d3559640 1 -- 172.21.15.106:0/4087910997 wait complete. 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.380+0000 7f17d3559640 1 Processor -- start 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.380+0000 7f17d3559640 1 -- start start 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d3559640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc1e1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d3559640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc1481c0 0x7f17cc1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d3559640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17cc148640 0x7f17cc14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc1481c0 0x7f17cc1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc1481c0 0x7f17cc1427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55454/0 (socket says 172.21.15.106:55454) 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 -- 172.21.15.106:0/3562084122 learned_addr learned my addr 172.21.15.106:0/3562084122 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc0b5ca0 con 0x7f17cc1481c0 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d12f5640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc1e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc0b5b20 con 0x7f17cc148640 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17cc152610 con 0x7f17cc0b63a0 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d1af6640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17cc148640 0x7f17cc14a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 -- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 msgr2=0x7f17cc1e1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc1e1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 -- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17cc148640 msgr2=0x7f17cc14a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17cc148640 0x7f17cc14a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.381+0000 7f17d0af4640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc14b030 con 0x7f17cc1481c0 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17d0af4640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc1481c0 0x7f17cc1427c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f17c800c430 tx=0x7f17c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17c1ffb640 1 -- 172.21.15.106:0/3562084122 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c8017070 con 0x7f17cc1481c0 2024-04-16T12:56:56.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17c1ffb640 1 -- 172.21.15.106:0/3562084122 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c8005ce0 con 0x7f17cc1481c0 2024-04-16T12:56:56.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc14ad50 con 0x7f17cc1481c0 2024-04-16T12:56:56.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc144600 con 0x7f17cc1481c0 2024-04-16T12:56:56.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17c1ffb640 1 -- 172.21.15.106:0/3562084122 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c80072f0 con 0x7f17cc1481c0 2024-04-16T12:56:56.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17c1ffb640 1 -- 172.21.15.106:0/3562084122 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f17c801a070 con 0x7f17cc1481c0 2024-04-16T12:56:56.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.382+0000 7f17c1ffb640 1 -- 172.21.15.106:0/3562084122 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f17c8007490 con 0x7f17cc1481c0 2024-04-16T12:56:56.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.383+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc068a90 con 0x7f17cc1481c0 2024-04-16T12:56:56.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.387+0000 7f17c1ffb640 1 -- 172.21.15.106:0/3562084122 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f17c8007690 con 0x7f17cc1481c0 2024-04-16T12:56:56.399 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.398+0000 7f641c20d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T12:56:56.417 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.416+0000 7f69af840040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:56:56.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.448+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17cc0b75b0 con 0x7f17cc1481c0 2024-04-16T12:56:56.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.449+0000 7f17c1ffb640 1 -- 172.21.15.106:0/3562084122 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f17c8012400 con 0x7f17cc1481c0 2024-04-16T12:56:56.451 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:56:56.451 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":10,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:56:56.203398+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:56.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc1481c0 msgr2=0x7f17cc1427c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc1481c0 0x7f17cc1427c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f17c800c430 tx=0x7f17c800c8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 shutdown_connections 2024-04-16T12:56:56.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17cc148640 0x7f17cc14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17cc1481c0 0x7f17cc1427c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 --2- 172.21.15.106:0/3562084122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17cc0b63a0 0x7f17cc1e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 >> 172.21.15.106:0/3562084122 conn(0x7f17cc068080 msgr2=0x7f17cc0b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 shutdown_connections 2024-04-16T12:56:56.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:56:56.450+0000 7f17d3559640 1 -- 172.21.15.106:0/3562084122 wait complete. 2024-04-16T12:56:56.462 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-16T12:56:56.462 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T12:56:56.513 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.512+0000 7f641c20d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:56:56.517 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.515+0000 7f69af840040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T12:56:56.611 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.609+0000 7f641c20d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T12:56:56.673 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.672+0000 7f69af840040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:56:56.715 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.713+0000 7f69af840040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T12:56:56.766 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.765+0000 7f641c20d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:56:56.809 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.808+0000 7f641c20d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T12:56:56.840 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-16T12:56:56.838+0000 7f527f173640 -1 Falling back to public interface 2024-04-16T12:56:56.840 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-16T12:56:56.839+0000 7f85fcd0f640 -1 Falling back to public interface 2024-04-16T12:56:56.841 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-16T12:56:56.840+0000 7f42f996b640 -1 Falling back to public interface 2024-04-16T12:56:56.845 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-16T12:56:56.843+0000 7f0bd720d640 -1 Falling back to public interface 2024-04-16T12:56:56.854 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-16T12:56:56.852+0000 7f0c9e6c4640 -1 Falling back to public interface 2024-04-16T12:56:56.864 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-16T12:56:56.862+0000 7f1a8b668640 -1 Falling back to public interface 2024-04-16T12:56:56.866 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-16T12:56:56.864+0000 7f236f385640 -1 Falling back to public interface 2024-04-16T12:56:56.866 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-16T12:56:56.864+0000 7feb266a6640 -1 Falling back to public interface 2024-04-16T12:56:56.866 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-16T12:56:56.865+0000 7feb25655640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-04-16T12:56:56.866 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-16T12:56:56.865+0000 7f236e334640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6818/0: (98) Address already in use 2024-04-16T12:56:56.868 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-16T12:56:56.866+0000 7f236e334640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6825/0: (98) Address already in use 2024-04-16T12:56:56.871 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:56.869+0000 7f69af840040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T12:56:56.972 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:56.971+0000 7f641c20d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T12:56:57.268 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:57.360 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.359+0000 7fb1fe863640 1 Processor -- start 2024-04-16T12:56:57.361 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.359+0000 7fb1fe863640 1 -- start start 2024-04-16T12:56:57.362 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.359+0000 7fb1fe863640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f80b59a0 0x7fb1f8072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.362 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.359+0000 7fb1fe863640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb1f80b0b20 0x7fb1f8148140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.359+0000 7fb1fe863640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f8072280 con 0x7fb1f8141f50 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.359+0000 7fb1fe863640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f80b1400 con 0x7fb1f80b0b20 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.359+0000 7fb1fe863640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f80b5d80 con 0x7fb1f80b59a0 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1fce00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb1f8141f50 0x7fb1f80b6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39710/0 (socket says 172.21.15.106:39710) 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1fce00640 1 -- 172.21.15.106:0/2113328674 learned_addr learned my addr 172.21.15.106:0/2113328674 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f77fe640 1 --2- 172.21.15.106:0/2113328674 >> v2:172.21.15.171:3300/0 conn(0x7fb1f80b0b20 0x7fb1f8148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f7fff640 1 --2- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f80b59a0 0x7fb1f8072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f6ffd640 1 -- 172.21.15.106:0/2113328674 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648100005 0 0) 0x7fb1e8001490 con 0x7fb1f8141f50 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f6ffd640 1 -- 172.21.15.106:0/2113328674 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e4003520 con 0x7fb1f8141f50 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f77fe640 1 -- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f80b59a0 msgr2=0x7fb1f8072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f77fe640 1 --2- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f80b59a0 0x7fb1f8072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f77fe640 1 -- 172.21.15.106:0/2113328674 >> v1:172.21.15.106:6789/0 conn(0x7fb1f8141f50 legacy=0x7fb1f80b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.360+0000 7fb1f77fe640 1 -- 172.21.15.106:0/2113328674 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f8071e80 con 0x7fb1f80b0b20 2024-04-16T12:56:57.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.361+0000 7fb1f77fe640 1 --2- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b0b20 0x7fb1f8148140 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00097a0 tx=0x7fb1e002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d7038d34f8ca89 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:57.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.361+0000 7fb1f6ffd640 1 -- 172.21.15.106:0/2113328674 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0038070 con 0x7fb1f80b0b20 2024-04-16T12:56:57.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.361+0000 7fb1f6ffd640 1 -- 172.21.15.106:0/2113328674 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e0031700 con 0x7fb1f80b0b20 2024-04-16T12:56:57.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.361+0000 7fb1f6ffd640 1 -- 172.21.15.106:0/2113328674 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0031ab0 con 0x7fb1f80b0b20 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 -- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b0b20 msgr2=0x7fb1f8148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 --2- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b0b20 0x7fb1f8148140 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00097a0 tx=0x7fb1e002b7a0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 -- 172.21.15.106:0/2113328674 shutdown_connections 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 --2- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b0b20 0x7fb1f8148140 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 --2- 172.21.15.106:0/2113328674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f80b59a0 0x7fb1f8072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 -- 172.21.15.106:0/2113328674 >> 172.21.15.106:0/2113328674 conn(0x7fb1f806ba20 msgr2=0x7fb1f806be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 -- 172.21.15.106:0/2113328674 shutdown_connections 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.362+0000 7fb1fe863640 1 -- 172.21.15.106:0/2113328674 wait complete. 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.363+0000 7fb1fe863640 1 Processor -- start 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.363+0000 7fb1fe863640 1 -- start start 2024-04-16T12:56:57.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b59a0 0x7fb1f8142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f8141f50 0x7fb1f8139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1f81382e0 0x7fb1f8131900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f8067920 con 0x7fb1f81382e0 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f8070be0 con 0x7fb1f80b59a0 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f8142380 con 0x7fb1f8141f50 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1f81382e0 0x7fb1f8131900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1f81382e0 0x7fb1f8131900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55462/0 (socket says 172.21.15.106:55462) 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 -- 172.21.15.106:0/665964305 learned_addr learned my addr 172.21.15.106:0/665964305 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1f7fff640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b59a0 0x7fb1f8142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1f77fe640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f8141f50 0x7fb1f8139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 -- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f8141f50 msgr2=0x7fb1f8139210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f8141f50 0x7fb1f8139210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.368 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 -- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b59a0 msgr2=0x7fb1f8142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b59a0 0x7fb1f8142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 -- 172.21.15.106:0/665964305 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f80b98a0 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fce00640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1f81382e0 0x7fb1f8131900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800cb10 tx=0x7fb1e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1f4ff9640 1 -- 172.21.15.106:0/665964305 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8017070 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1f4ff9640 1 -- 172.21.15.106:0/665964305 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e800ac10 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1f4ff9640 1 -- 172.21.15.106:0/665964305 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8012400 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f81387c0 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f8139750 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1f4ff9640 1 -- 172.21.15.106:0/665964305 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb1e801a070 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.364+0000 7fb1f4ff9640 1 -- 172.21.15.106:0/665964305 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb1e8007740 con 0x7fb1f81382e0 2024-04-16T12:56:57.369 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.365+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f81dec70 con 0x7fb1f81382e0 2024-04-16T12:56:57.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.367+0000 7fb1f4ff9640 1 -- 172.21.15.106:0/665964305 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb1e8021020 con 0x7fb1f81382e0 2024-04-16T12:56:57.431 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.429+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1f8072a90 con 0x7fb1f81382e0 2024-04-16T12:56:57.431 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.430+0000 7fb1f4ff9640 1 -- 172.21.15.106:0/665964305 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb1f8072280 con 0x7fb1f81382e0 2024-04-16T12:56:57.432 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-16T12:56:57.432 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":10,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:56:56.203398+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1f81382e0 msgr2=0x7fb1f8131900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1f81382e0 0x7fb1f8131900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800cb10 tx=0x7fb1e800a060 comp rx=0 tx=0).stop 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 shutdown_connections 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1f81382e0 0x7fb1f8131900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1f8141f50 0x7fb1f8139210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 --2- 172.21.15.106:0/665964305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1f80b59a0 0x7fb1f8142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 >> 172.21.15.106:0/665964305 conn(0x7fb1f806ba20 msgr2=0x7fb1f813fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 shutdown_connections 2024-04-16T12:56:57.433 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:56:57.431+0000 7fb1fe863640 1 -- 172.21.15.106:0/665964305 wait complete. 2024-04-16T12:56:57.442 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T12:56:57.711 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:57.709+0000 7f69af840040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T12:56:57.813 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:57.811+0000 7f641c20d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T12:56:57.986 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:57.984+0000 7f69af840040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T12:56:58.038 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:58.036+0000 7f69af840040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T12:56:58.098 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:58.096+0000 7f641c20d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T12:56:58.150 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:58.149+0000 7f641c20d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T12:56:58.153 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:58.152+0000 7f69af840040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T12:56:58.275 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-16T12:56:58.273+0000 7f641c20d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T12:56:59.170 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:59.168+0000 7f69505a9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-16T12:56:59.170 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-16T12:56:59.168+0000 7f69505a9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-16T12:57:00.346 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-16T12:57:00.345+0000 7f0bd720d640 -1 osd.1 0 log_to_monitors true 2024-04-16T12:57:00.356 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-16T12:57:00.354+0000 7f527f173640 -1 osd.5 0 log_to_monitors true 2024-04-16T12:57:00.391 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-16T12:57:00.390+0000 7f42f996b640 -1 osd.0 0 log_to_monitors true 2024-04-16T12:57:00.396 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-16T12:57:00.395+0000 7f1a8b668640 -1 osd.2 0 log_to_monitors true 2024-04-16T12:57:00.402 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-16T12:57:00.401+0000 7f0c9e6c4640 -1 osd.3 0 log_to_monitors true 2024-04-16T12:57:00.409 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-16T12:57:00.408+0000 7f85fcd0f640 -1 osd.4 0 log_to_monitors true 2024-04-16T12:57:00.418 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-16T12:57:00.416+0000 7f236f385640 -1 osd.6 0 log_to_monitors true 2024-04-16T12:57:00.418 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-16T12:57:00.416+0000 7feb266a6640 -1 osd.7 0 log_to_monitors true 2024-04-16T12:57:04.241 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-16T12:57:04.240+0000 7f85f94b9640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T12:57:04.249 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:04.254 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-16T12:57:04.253+0000 7f85f0ac5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.270 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-16T12:57:04.269+0000 7feb2263c640 -1 osd.7 0 waiting for initial osdmap 2024-04-16T12:57:04.279 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-16T12:57:04.278+0000 7feb1a45c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.301 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-16T12:57:04.299+0000 7f1a875fe640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T12:57:04.304 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-16T12:57:04.302+0000 7f42f5901640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T12:57:04.305 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-16T12:57:04.304+0000 7f0bd2b3a640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T12:57:04.316 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-16T12:57:04.315+0000 7f42ed721640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.316 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-16T12:57:04.315+0000 7f1a7f41e640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.325 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-16T12:57:04.324+0000 7f0bca95a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.329 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-16T12:57:04.328+0000 7f0c9a65a640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T12:57:04.341 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-16T12:57:04.340+0000 7f0c9247a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.352 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-16T12:57:04.351+0000 7f236b31b640 -1 osd.6 0 waiting for initial osdmap 2024-04-16T12:57:04.361 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-16T12:57:04.359+0000 7f527b109640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T12:57:04.362 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-16T12:57:04.361+0000 7f236313b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.361+0000 7fea4f281640 1 Processor -- start 2024-04-16T12:57:04.363 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.361+0000 7fea4f281640 1 -- start start 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4f281640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fea4813ebd0 0x7fea48144af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4f281640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fea4813efb0 0x7fea480b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4f281640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea480b8340 con 0x7fea480b9fe0 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4f281640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fea480b8620 con 0x7fea4813efb0 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4f281640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fea480b8900 con 0x7fea4813ebd0 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d81e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fea4813efb0 0x7fea480b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d81e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fea4813efb0 0x7fea480b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40008/0 (socket says 172.21.15.106:40008) 2024-04-16T12:57:04.364 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d81e640 1 -- 172.21.15.106:0/3217834840 learned_addr learned my addr 172.21.15.106:0/3217834840 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:04.365 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d01d640 1 --2- 172.21.15.106:0/3217834840 >> v2:172.21.15.171:3300/0 conn(0x7fea4813ebd0 0x7fea48144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:04.365 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d81e640 1 -- 172.21.15.106:0/3217834840 >> v2:172.21.15.171:3300/0 conn(0x7fea4813ebd0 msgr2=0x7fea48144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:04.365 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d81e640 1 --2- 172.21.15.106:0/3217834840 >> v2:172.21.15.171:3300/0 conn(0x7fea4813ebd0 0x7fea48144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.365 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d81e640 1 -- 172.21.15.106:0/3217834840 >> v1:172.21.15.171:6789/0 conn(0x7fea480b9fe0 legacy=0x7fea480b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:04.365 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.362+0000 7fea4d81e640 1 -- 172.21.15.106:0/3217834840 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea48145030 con 0x7fea4813efb0 2024-04-16T12:57:04.366 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.363+0000 7fea4d81e640 1 --2- 172.21.15.106:0/3217834840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea4813efb0 0x7fea480b66a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea48075910 tx=0x7fea4002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f344bb667dcf9f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:04.366 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.363+0000 7fea3ffff640 1 -- 172.21.15.106:0/3217834840 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4002cb20 con 0x7fea4813efb0 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.363+0000 7fea3ffff640 1 -- 172.21.15.106:0/3217834840 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4002ccc0 con 0x7fea4813efb0 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.363+0000 7fea3ffff640 1 -- 172.21.15.106:0/3217834840 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40034610 con 0x7fea4813efb0 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 -- 172.21.15.106:0/3217834840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea4813efb0 msgr2=0x7fea480b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 --2- 172.21.15.106:0/3217834840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea4813efb0 0x7fea480b66a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea48075910 tx=0x7fea4002bf80 comp rx=0 tx=0).stop 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 -- 172.21.15.106:0/3217834840 shutdown_connections 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 --2- 172.21.15.106:0/3217834840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea4813efb0 0x7fea480b66a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 --2- 172.21.15.106:0/3217834840 >> v2:172.21.15.171:3300/0 conn(0x7fea4813ebd0 0x7fea48144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 -- 172.21.15.106:0/3217834840 >> 172.21.15.106:0/3217834840 conn(0x7fea4809c250 msgr2=0x7fea4809c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 -- 172.21.15.106:0/3217834840 shutdown_connections 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.364+0000 7fea4f281640 1 -- 172.21.15.106:0/3217834840 wait complete. 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.365+0000 7fea4f281640 1 Processor -- start 2024-04-16T12:57:04.367 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.365+0000 7fea4f281640 1 -- start start 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.365+0000 7fea4f281640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea480b9fe0 0x7fea480988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.365+0000 7fea4f281640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4813ebd0 0x7fea481467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4f281640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4813efb0 0x7fea48099b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4f281640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fea480b8e20 con 0x7fea480b9fe0 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4f281640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fea480b6df0 con 0x7fea4813efb0 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4f281640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fea480b8fa0 con 0x7fea4813ebd0 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea480b9fe0 0x7fea480988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea480b9fe0 0x7fea480988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40014/0 (socket says 172.21.15.106:40014) 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 -- 172.21.15.106:0/8075870 learned_addr learned my addr 172.21.15.106:0/8075870 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:04.370 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d81e640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4813efb0 0x7fea48099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:04.371 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4c81c640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4813ebd0 0x7fea481467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:04.371 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 -- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4813ebd0 msgr2=0x7fea481467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:04.371 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4813ebd0 0x7fea481467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.371 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 -- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4813efb0 msgr2=0x7fea48099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:04.371 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4813efb0 0x7fea48099b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.371 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 -- 172.21.15.106:0/8075870 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea48142930 con 0x7fea480b9fe0 2024-04-16T12:57:04.371 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4d01d640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea480b9fe0 0x7fea480988f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e9b0 tx=0x7fea4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:04.372 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea3dffb640 1 -- 172.21.15.106:0/8075870 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44017070 con 0x7fea480b9fe0 2024-04-16T12:57:04.372 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea3dffb640 1 -- 172.21.15.106:0/8075870 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4400c9a0 con 0x7fea480b9fe0 2024-04-16T12:57:04.372 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea48146060 con 0x7fea480b9fe0 2024-04-16T12:57:04.372 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea3dffb640 1 -- 172.21.15.106:0/8075870 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4400cd90 con 0x7fea480b9fe0 2024-04-16T12:57:04.372 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.366+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea48146d10 con 0x7fea480b9fe0 2024-04-16T12:57:04.372 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.368+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea4804fd90 con 0x7fea480b9fe0 2024-04-16T12:57:04.373 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.368+0000 7fea3dffb640 1 -- 172.21.15.106:0/8075870 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fea4401a070 con 0x7fea480b9fe0 2024-04-16T12:57:04.373 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.368+0000 7fea3dffb640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fea2c06c860 0x7fea2c06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:04.373 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.368+0000 7fea3dffb640 1 -- 172.21.15.106:0/8075870 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fea4408ab70 con 0x7fea480b9fe0 2024-04-16T12:57:04.373 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.368+0000 7fea4c81c640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fea2c06c860 0x7fea2c06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:04.373 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.368+0000 7fea4c81c640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fea2c06c860 0x7fea2c06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea48099450 tx=0x7fea38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:04.374 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-16T12:57:04.369+0000 7f5272f29640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:57:04.374 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.373+0000 7fea3dffb640 1 -- 172.21.15.106:0/8075870 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea44059850 con 0x7fea480b9fe0 2024-04-16T12:57:04.551 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.549+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea480a0580 con 0x7fea480b9fe0 2024-04-16T12:57:04.552 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.550+0000 7fea3dffb640 1 -- 172.21.15.106:0/8075870 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fea4405db50 con 0x7fea480b9fe0 2024-04-16T12:57:04.552 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-16T12:57:04.552 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":12,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:02.176466+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fea2c06c860 msgr2=0x7fea2c06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fea2c06c860 0x7fea2c06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea48099450 tx=0x7fea38009040 comp rx=0 tx=0).stop 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea480b9fe0 msgr2=0x7fea480988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea480b9fe0 0x7fea480988f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e9b0 tx=0x7fea4400ee70 comp rx=0 tx=0).stop 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 shutdown_connections 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fea2c06c860 0x7fea2c06ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4813efb0 0x7fea48099b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4813ebd0 0x7fea481467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 --2- 172.21.15.106:0/8075870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea480b9fe0 0x7fea480988f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 >> 172.21.15.106:0/8075870 conn(0x7fea4809c250 msgr2=0x7fea48074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:04.554 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 shutdown_connections 2024-04-16T12:57:04.555 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:04.552+0000 7fea4f281640 1 -- 172.21.15.106:0/8075870 wait complete. 2024-04-16T12:57:04.563 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T12:57:11.371 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.475+0000 7f74e2b3d640 1 Processor -- start 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.475+0000 7f74e2b3d640 1 -- start start 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e2b3d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74dc0b3fd0 0x7f74dc148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e2b3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc14f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e2b3d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74dc144e60 con 0x7f74dc1449e0 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e2b3d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f74dc148620 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e2b3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc0b43b0 con 0x7f74dc14d350 2024-04-16T12:57:11.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e08d9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74dc0b3fd0 0x7f74dc148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.479 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e08d9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74dc0b3fd0 0x7f74dc148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40030/0 (socket says 172.21.15.106:40030) 2024-04-16T12:57:11.479 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e08d9640 1 -- 172.21.15.106:0/1968690497 learned_addr learned my addr 172.21.15.106:0/1968690497 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:11.479 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e10da640 1 --2- 172.21.15.106:0/1968690497 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.479 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e08d9640 1 -- 172.21.15.106:0/1968690497 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 msgr2=0x7f74dc14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:11.479 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e08d9640 1 --2- 172.21.15.106:0/1968690497 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc14f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.479 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e08d9640 1 -- 172.21.15.106:0/1968690497 >> v1:172.21.15.171:6789/0 conn(0x7f74dc1449e0 legacy=0x7f74dc072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:11.479 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.476+0000 7f74e08d9640 1 -- 172.21.15.106:0/1968690497 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc0b5700 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.477+0000 7f74e08d9640 1 --2- 172.21.15.106:0/1968690497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc148ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009870 tx=0x7f74d802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f0e0ae7a9b8c48 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:11.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.477+0000 7f74d37fe640 1 -- 172.21.15.106:0/1968690497 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8038070 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.477+0000 7f74d37fe640 1 -- 172.21.15.106:0/1968690497 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d8031740 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.477+0000 7f74d37fe640 1 -- 172.21.15.106:0/1968690497 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d802f050 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 -- 172.21.15.106:0/1968690497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 msgr2=0x7f74dc148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/1968690497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc148ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009870 tx=0x7f74d802b7e0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 -- 172.21.15.106:0/1968690497 shutdown_connections 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/1968690497 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/1968690497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc148ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 -- 172.21.15.106:0/1968690497 >> 172.21.15.106:0/1968690497 conn(0x7f74dc06c570 msgr2=0x7f74dc0b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 -- 172.21.15.106:0/1968690497 shutdown_connections 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.478+0000 7f74e2b3d640 1 -- 172.21.15.106:0/1968690497 wait complete. 2024-04-16T12:57:11.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.479+0000 7f74e2b3d640 1 Processor -- start 2024-04-16T12:57:11.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.479+0000 7f74e2b3d640 1 -- start start 2024-04-16T12:57:11.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e2b3d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc1d4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e2b3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74dc1449e0 0x7f74dc1d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e2b3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc1de1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e2b3d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc0b36b0 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e2b3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc1482b0 con 0x7f74dc1449e0 2024-04-16T12:57:11.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e2b3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc0b3830 con 0x7f74dc14d350 2024-04-16T12:57:11.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc1d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc1d4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40032/0 (socket says 172.21.15.106:40032) 2024-04-16T12:57:11.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 -- 172.21.15.106:0/2192944011 learned_addr learned my addr 172.21.15.106:0/2192944011 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:11.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e10da640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc1de1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 -- 172.21.15.106:0/2192944011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 msgr2=0x7f74dc1de1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc1de1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 -- 172.21.15.106:0/2192944011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74dc1449e0 msgr2=0x7f74dc1d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74dc1449e0 0x7f74dc1d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 -- 172.21.15.106:0/2192944011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc13f5f0 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.480+0000 7f74e08d9640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc1d4570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009870 tx=0x7f74d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:11.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.481+0000 7f74d17fa640 1 -- 172.21.15.106:0/2192944011 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8042070 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.481+0000 7f74d17fa640 1 -- 172.21.15.106:0/2192944011 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d8031e80 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.481+0000 7f74d17fa640 1 -- 172.21.15.106:0/2192944011 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8038040 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.481+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc0af8d0 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.481+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc1d3780 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.482+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74dc04fd90 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.482+0000 7f74d17fa640 1 -- 172.21.15.106:0/2192944011 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74d8045070 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.483+0000 7f74d17fa640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c806c8f0 0x7f74c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.491 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.483+0000 7f74d17fa640 1 -- 172.21.15.106:0/2192944011 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f74d80ad450 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.491 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.483+0000 7f74d3fff640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c806c8f0 0x7f74c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.491 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.483+0000 7f74d3fff640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c806c8f0 0x7f74c806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0afc60 tx=0x7f74cc0079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:11.492 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.487+0000 7f74d17fa640 1 -- 172.21.15.106:0/2192944011 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74d804c030 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.664 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.663+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74dc0b2d80 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.665 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.663+0000 7f74d17fa640 1 -- 172.21.15.106:0/2192944011 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f74dc144e60 con 0x7f74dc0b3fd0 2024-04-16T12:57:11.665 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-16T12:57:11.665 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":16,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:08.249649+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:11.667 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c806c8f0 msgr2=0x7f74c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.667 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c806c8f0 0x7f74c806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0afc60 tx=0x7f74cc0079b0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.667 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 msgr2=0x7f74dc1d4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc1d4570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009870 tx=0x7f74d80046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 shutdown_connections 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c806c8f0 0x7f74c806edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74dc14d350 0x7f74dc1de1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74dc1449e0 0x7f74dc1d4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 --2- 172.21.15.106:0/2192944011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0b3fd0 0x7f74dc1d4570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 >> 172.21.15.106:0/2192944011 conn(0x7f74dc06c570 msgr2=0x7f74dc0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 shutdown_connections 2024-04-16T12:57:11.668 INFO:teuthology.misc.health.smithi106.stderr:2024-04-16T12:57:11.665+0000 7f74e2b3d640 1 -- 172.21.15.106:0/2192944011 wait complete. 2024-04-16T12:57:11.678 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-16T12:57:11.678 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-16T12:57:11.678 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T12:57:11.678 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T12:57:11.681 INFO:tasks.ceph.mds.a:Started 2024-04-16T12:57:11.682 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T12:57:11.682 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T12:57:11.685 INFO:tasks.ceph.mds.b:Started 2024-04-16T12:57:11.685 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-16T12:57:11.685 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:11.758 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-04-16T12:57:11.772 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-04-16T12:57:11.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.790+0000 7f6708331640 1 Processor -- start 2024-04-16T12:57:11.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.790+0000 7f6708331640 1 -- start start 2024-04-16T12:57:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f6708331640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 0x7f670006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f6708331640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67000b5ac0 con 0x7f67000b56e0 2024-04-16T12:57:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f6708331640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670006ea60 con 0x7f6700141bb0 2024-04-16T12:57:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f6708331640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6700148dd0 con 0x7f67000b7b60 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67060cd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f67000b56e0 0x7f67001486c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52988/0 (socket says 172.21.15.106:52988) 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67060cd640 1 -- 172.21.15.106:0/804030495 learned_addr learned my addr 172.21.15.106:0/804030495 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67058cc640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 0x7f670006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420021254 0 0) 0x7f67000b5ac0 con 0x7f67000b56e0 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ec003520 con 0x7f67000b56e0 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250325079 0 0) 0x7f670006ea60 con 0x7f6700141bb0 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67000b5ac0 con 0x7f6700141bb0 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 539538706 0 0) 0x7f66ec003520 con 0x7f67000b56e0 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 msgr2=0x7f670006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 0x7f670006e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 >> v1:172.21.15.171:6789/0 conn(0x7f6700141bb0 legacy=0x7f6700152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6700147ec0 con 0x7f67000b56e0 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f66fc001670 con 0x7f67000b56e0 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 >> v1:172.21.15.106:6789/0 conn(0x7f67000b56e0 legacy=0x7f67001486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 0x7f66ec003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66ec004120 0x7f66ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004d40 0x7f66ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6700148dd0 con 0x7f66ec004120 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec00bb00 con 0x7f66ec004d40 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.791+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec00bd00 con 0x7f67000b7b60 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67058cc640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66ec004120 0x7f66ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67068ce640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004d40 0x7f66ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67060cd640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 0x7f66ec003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67058cc640 1 -- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 msgr2=0x7f66ec003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67058cc640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67000b7b60 0x7f66ec003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67058cc640 1 -- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004d40 msgr2=0x7f66ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67058cc640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004d40 0x7f66ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67058cc640 1 -- 172.21.15.106:0/804030495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec003520 con 0x7f66ec004120 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.792+0000 7f67058cc640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66ec004120 0x7f66ec004800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009ac0 tx=0x7f66ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7771cb45c26420 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0039070 con 0x7f66ec004120 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f002c600 con 0x7f66ec004120 2024-04-16T12:57:11.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f67050cb640 1 -- 172.21.15.106:0/804030495 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0009690 con 0x7f66ec004120 2024-04-16T12:57:11.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f6708331640 1 -- 172.21.15.106:0/804030495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66ec004120 msgr2=0x7f66ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f6708331640 1 --2- 172.21.15.106:0/804030495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66ec004120 0x7f66ec004800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009ac0 tx=0x7f66ec005830 comp rx=0 tx=0).stop 2024-04-16T12:57:11.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f67068ce640 1 -- 172.21.15.106:0/804030495 reap_dead start 2024-04-16T12:57:11.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f6708331640 1 -- 172.21.15.106:0/804030495 shutdown_connections 2024-04-16T12:57:11.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f6708331640 1 -- 172.21.15.106:0/804030495 >> 172.21.15.106:0/804030495 conn(0x7f67000bb650 msgr2=0x7f67000bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:11.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f6708331640 1 -- 172.21.15.106:0/804030495 shutdown_connections 2024-04-16T12:57:11.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.793+0000 7f6708331640 1 -- 172.21.15.106:0/804030495 wait complete. 2024-04-16T12:57:11.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.794+0000 7f6708331640 1 Processor -- start 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.794+0000 7f6708331640 1 -- start start 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f6708331640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004120 0x7f67001d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f6708331640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6700144ad0 0x7f67001e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f6708331640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67001e1240 0x7f670013de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f6708331640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f670006df90 con 0x7f67001e1240 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f6708331640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6700148230 con 0x7f66ec004120 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f6708331640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f670006e420 con 0x7f6700144ad0 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67001e1240 0x7f670013de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67001e1240 0x7f670013de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40062/0 (socket says 172.21.15.106:40062) 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 -- 172.21.15.106:0/4213988025 learned_addr learned my addr 172.21.15.106:0/4213988025 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67058cc640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6700144ad0 0x7f67001e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67060cd640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004120 0x7f67001d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 -- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6700144ad0 msgr2=0x7f67001e0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6700144ad0 0x7f67001e0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 -- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004120 msgr2=0x7f67001d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004120 0x7f67001d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 -- 172.21.15.106:0/4213988025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67001e16c0 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f67068ce640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67001e1240 0x7f670013de70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6700070ab0 tx=0x7f66f800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f66f6ffd640 1 -- 172.21.15.106:0/4213988025 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8019070 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f66f6ffd640 1 -- 172.21.15.106:0/4213988025 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f8006e20 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67001d2c40 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.795+0000 7f66f6ffd640 1 -- 172.21.15.106:0/4213988025 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8003b70 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.796+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67001d1ad0 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.796+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67000691a0 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.797+0000 7f66f6ffd640 1 -- 172.21.15.106:0/4213988025 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66f8003d10 con 0x7f67001e1240 2024-04-16T12:57:11.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.797+0000 7f66f6ffd640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f66e406c920 0x7f66e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:11.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.797+0000 7f66f6ffd640 1 -- 172.21.15.106:0/4213988025 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f66f808aac0 con 0x7f67001e1240 2024-04-16T12:57:11.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.797+0000 7f67060cd640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f66e406c920 0x7f66e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:11.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.798+0000 7f67060cd640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f66e406c920 0x7f66e406ede0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66fc001050 tx=0x7f66fc000f80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:11.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.802+0000 7f66f6ffd640 1 -- 172.21.15.106:0/4213988025 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67001e16c0 con 0x7f67001e1240 2024-04-16T12:57:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.983+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6700140580 con 0x7f67001e1240 2024-04-16T12:57:11.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.984+0000 7f66f6ffd640 1 -- 172.21.15.106:0/4213988025 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f66f8058bf0 con 0x7f67001e1240 2024-04-16T12:57:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:11.985 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:08.249649+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f66e406c920 msgr2=0x7f66e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f66e406c920 0x7f66e406ede0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66fc001050 tx=0x7f66fc000f80 comp rx=0 tx=0).stop 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67001e1240 msgr2=0x7f670013de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67001e1240 0x7f670013de70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6700070ab0 tx=0x7f66f800ff70 comp rx=0 tx=0).stop 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 shutdown_connections 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f66e406c920 0x7f66e406ede0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67001e1240 0x7f670013de70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6700144ad0 0x7f67001e0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 --2- 172.21.15.106:0/4213988025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66ec004120 0x7f67001d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 >> 172.21.15.106:0/4213988025 conn(0x7f67000bb650 msgr2=0x7f6700140d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 shutdown_connections 2024-04-16T12:57:11.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:11.986+0000 7f6708331640 1 -- 172.21.15.106:0/4213988025 wait complete. 2024-04-16T12:57:12.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:12.001 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.106+0000 7f7c9ded9640 1 Processor -- start 2024-04-16T12:57:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.106+0000 7f7c9ded9640 1 -- start start 2024-04-16T12:57:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c9ded9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c981421a0 0x7f7c98153600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c9ded9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c980b7c80 con 0x7f7c980b6100 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c9ded9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c980b6f80 con 0x7f7c980b78a0 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c9ded9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f7c980b1d80 con 0x7f7c981421a0 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c97fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c981421a0 0x7f7c98153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c96ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7c980b6100 0x7f7c98141a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52992/0 (socket says 172.21.15.106:52992) 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c97fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c981421a0 0x7f7c98153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40070/0 (socket says 172.21.15.106:40070) 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c96ffd640 1 -- 172.21.15.106:0/1252155260 learned_addr learned my addr 172.21.15.106:0/1252155260 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c97fff640 1 -- 172.21.15.106:0/1252155260 >> v1:172.21.15.171:6789/0 conn(0x7f7c980b78a0 legacy=0x7f7c9806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c97fff640 1 -- 172.21.15.106:0/1252155260 >> v1:172.21.15.106:6789/0 conn(0x7f7c980b6100 legacy=0x7f7c98141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.107+0000 7f7c97fff640 1 -- 172.21.15.106:0/1252155260 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9806e6f0 con 0x7f7c981421a0 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c97fff640 1 --2- 172.21.15.106:0/1252155260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c98153600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009d90 tx=0x7f7c9002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93cd3552bbca26a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c967fc640 1 -- 172.21.15.106:0/1252155260 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90039070 con 0x7f7c981421a0 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c967fc640 1 -- 172.21.15.106:0/1252155260 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9002cb40 con 0x7f7c981421a0 2024-04-16T12:57:12.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c967fc640 1 -- 172.21.15.106:0/1252155260 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90034440 con 0x7f7c981421a0 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c9ded9640 1 -- 172.21.15.106:0/1252155260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 msgr2=0x7f7c98153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/1252155260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c98153600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009d90 tx=0x7f7c9002bd90 comp rx=0 tx=0).stop 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c9ded9640 1 -- 172.21.15.106:0/1252155260 shutdown_connections 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.108+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/1252155260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c98153600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.109+0000 7f7c9ded9640 1 -- 172.21.15.106:0/1252155260 >> 172.21.15.106:0/1252155260 conn(0x7f7c980b7e90 msgr2=0x7f7c980b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.109+0000 7f7c9ded9640 1 -- 172.21.15.106:0/1252155260 shutdown_connections 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.109+0000 7f7c9ded9640 1 -- 172.21.15.106:0/1252155260 wait complete. 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.109+0000 7f7c9ded9640 1 Processor -- start 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c9ded9640 1 -- start start 2024-04-16T12:57:12.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c9ded9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c980b6100 0x7f7c980b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c9ded9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c980b78a0 0x7f7c981e1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c9ded9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c981e1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c9ded9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7c980b6d20 con 0x7f7c981421a0 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c9ded9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c980b6ba0 con 0x7f7c980b6100 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c9ded9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c980b5d90 con 0x7f7c980b78a0 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c981e1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c981e1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40082/0 (socket says 172.21.15.106:40082) 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.110+0000 7f7c97fff640 1 -- 172.21.15.106:0/2966251195 learned_addr learned my addr 172.21.15.106:0/2966251195 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c96ffd640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c980b78a0 0x7f7c981e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c97fff640 1 -- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c980b78a0 msgr2=0x7f7c981e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c97fff640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c980b78a0 0x7f7c981e1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c977fe640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c980b6100 0x7f7c980b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c97fff640 1 -- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c980b6100 msgr2=0x7f7c980b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c97fff640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c980b6100 0x7f7c980b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c97fff640 1 -- 172.21.15.106:0/2966251195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c980baae0 con 0x7f7c981421a0 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c977fe640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c980b6100 0x7f7c980b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c97fff640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c981e1640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c90037040 tx=0x7f7c90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c7ffff640 1 -- 172.21.15.106:0/2966251195 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90039050 con 0x7f7c981421a0 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c7ffff640 1 -- 172.21.15.106:0/2966251195 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90045070 con 0x7f7c981421a0 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c7ffff640 1 -- 172.21.15.106:0/2966251195 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9003ea50 con 0x7f7c981421a0 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c980badc0 con 0x7f7c981421a0 2024-04-16T12:57:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.111+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c980bb510 con 0x7f7c981421a0 2024-04-16T12:57:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.112+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9806c210 con 0x7f7c981421a0 2024-04-16T12:57:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.113+0000 7f7c7ffff640 1 -- 172.21.15.106:0/2966251195 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c9002c9c0 con 0x7f7c981421a0 2024-04-16T12:57:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.113+0000 7f7c7ffff640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7c8406c920 0x7f7c8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.113+0000 7f7c7ffff640 1 -- 172.21.15.106:0/2966251195 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7c900adfa0 con 0x7f7c981421a0 2024-04-16T12:57:12.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.113+0000 7f7c977fe640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7c8406c920 0x7f7c8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.113+0000 7f7c977fe640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7c8406c920 0x7f7c8406ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c88003eb0 tx=0x7f7c88009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:12.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.117+0000 7f7c7ffff640 1 -- 172.21.15.106:0/2966251195 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c9004e020 con 0x7f7c981421a0 2024-04-16T12:57:12.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.291+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7c98147030 con 0x7f7c981421a0 2024-04-16T12:57:12.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.292+0000 7f7c7ffff640 1 -- 172.21.15.106:0/2966251195 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f7c9007c7b0 con 0x7f7c981421a0 2024-04-16T12:57:12.294 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:12.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7c8406c920 msgr2=0x7f7c8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7c8406c920 0x7f7c8406ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c88003eb0 tx=0x7f7c88009040 comp rx=0 tx=0).stop 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 msgr2=0x7f7c981e1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c981e1640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c90037040 tx=0x7f7c90004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 shutdown_connections 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7c8406c920 0x7f7c8406ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c981421a0 0x7f7c981e1640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c980b78a0 0x7f7c981e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 --2- 172.21.15.106:0/2966251195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c980b6100 0x7f7c980b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 >> 172.21.15.106:0/2966251195 conn(0x7f7c980b7e90 msgr2=0x7f7c98145ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 shutdown_connections 2024-04-16T12:57:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.294+0000 7f7c9ded9640 1 -- 172.21.15.106:0/2966251195 wait complete. 2024-04-16T12:57:12.307 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:12.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.408+0000 7fd3c7c47640 1 Processor -- start 2024-04-16T12:57:12.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c7c47640 1 -- start start 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c7c47640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c00bdfa0 0x7fd3c0141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c7c47640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd3c0142300 0x7fd3c014b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c7c47640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3c014b8d0 0x7fd3c00b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c7c47640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c00b4fa0 con 0x7fd3c014b8d0 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c7c47640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c00be380 con 0x7fd3c0142300 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c7c47640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c00b4c30 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c61e4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3c014b8d0 0x7fd3c00b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c61e4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3c014b8d0 0x7fd3c00b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40096/0 (socket says 172.21.15.106:40096) 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.409+0000 7fd3c61e4640 1 -- 172.21.15.106:0/1520472155 learned_addr learned my addr 172.21.15.106:0/1520472155 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c59e3640 1 --2- 172.21.15.106:0/1520472155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c00bdfa0 0x7fd3c0141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c51e2640 1 --2- 172.21.15.106:0/1520472155 >> v2:172.21.15.171:3300/0 conn(0x7fd3c0142300 0x7fd3c014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c61e4640 1 -- 172.21.15.106:0/1520472155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c00bdfa0 msgr2=0x7fd3c0141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c61e4640 1 --2- 172.21.15.106:0/1520472155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c00bdfa0 0x7fd3c0141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c61e4640 1 -- 172.21.15.106:0/1520472155 >> v2:172.21.15.171:3300/0 conn(0x7fd3c0142300 msgr2=0x7fd3c014b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c61e4640 1 --2- 172.21.15.106:0/1520472155 >> v2:172.21.15.171:3300/0 conn(0x7fd3c0142300 0x7fd3c014b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c61e4640 1 -- 172.21.15.106:0/1520472155 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c00b43e0 con 0x7fd3c014b8d0 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c59e3640 1 --2- 172.21.15.106:0/1520472155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c00bdfa0 0x7fd3c0141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c51e2640 1 --2- 172.21.15.106:0/1520472155 >> v2:172.21.15.171:3300/0 conn(0x7fd3c0142300 0x7fd3c014b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.410+0000 7fd3c61e4640 1 --2- 172.21.15.106:0/1520472155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c014b8d0 0x7fd3c00b7fa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00be640 tx=0x7fd3b802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4da62bd47e5245 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c49e1640 1 -- 172.21.15.106:0/1520472155 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b802c950 con 0x7fd3c014b8d0 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c49e1640 1 -- 172.21.15.106:0/1520472155 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b802caf0 con 0x7fd3c014b8d0 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c49e1640 1 -- 172.21.15.106:0/1520472155 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80343f0 con 0x7fd3c014b8d0 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1520472155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c014b8d0 msgr2=0x7fd3c00b7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1520472155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c014b8d0 0x7fd3c00b7fa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00be640 tx=0x7fd3b802bdb0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1520472155 shutdown_connections 2024-04-16T12:57:12.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1520472155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c014b8d0 0x7fd3c00b7fa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1520472155 >> v2:172.21.15.171:3300/0 conn(0x7fd3c0142300 0x7fd3c014b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1520472155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c00bdfa0 0x7fd3c0141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1520472155 >> 172.21.15.106:0/1520472155 conn(0x7fd3c0067dc0 msgr2=0x7fd3c00bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:12.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1520472155 shutdown_connections 2024-04-16T12:57:12.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.411+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1520472155 wait complete. 2024-04-16T12:57:12.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.412+0000 7fd3c7c47640 1 Processor -- start 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.412+0000 7fd3c7c47640 1 -- start start 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c7c47640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c00bdfa0 0x7fd3c0145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c7c47640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3c0142300 0x7fd3c00b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c7c47640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c014b8d0 0x7fd3c01487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c7c47640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00b5640 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c7c47640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00b54c0 con 0x7fd3c0142300 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c7c47640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c00b5e20 con 0x7fd3c014b8d0 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c00bdfa0 0x7fd3c0145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c00bdfa0 0x7fd3c0145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40098/0 (socket says 172.21.15.106:40098) 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 -- 172.21.15.106:0/1646912953 learned_addr learned my addr 172.21.15.106:0/1646912953 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c51e2640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3c0142300 0x7fd3c00b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c61e4640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c014b8d0 0x7fd3c01487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 -- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c014b8d0 msgr2=0x7fd3c01487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c014b8d0 0x7fd3c01487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 -- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3c0142300 msgr2=0x7fd3c00b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3c0142300 0x7fd3c00b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.413+0000 7fd3c59e3640 1 -- 172.21.15.106:0/1646912953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c00b34c0 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.414+0000 7fd3c59e3640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c00bdfa0 0x7fd3c0145c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c7f0 tx=0x7fd3b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.414+0000 7fd3b27fc640 1 -- 172.21.15.106:0/1646912953 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4015070 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.414+0000 7fd3b27fc640 1 -- 172.21.15.106:0/1646912953 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b4007a30 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.414+0000 7fd3b27fc640 1 -- 172.21.15.106:0/1646912953 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4007e00 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.414+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c00b21d0 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.414+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c00b31e0 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.415+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c00691a0 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.415+0000 7fd3b27fc640 1 -- 172.21.15.106:0/1646912953 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd3b4018070 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.416+0000 7fd3b27fc640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd3a406c8f0 0x7fd3a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:12.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.416+0000 7fd3c51e2640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd3a406c8f0 0x7fd3a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:12.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.416+0000 7fd3b27fc640 1 -- 172.21.15.106:0/1646912953 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd3b408b6a0 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.416+0000 7fd3c51e2640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd3a406c8f0 0x7fd3a406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3c01d4ee0 tx=0x7fd3bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:12.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.420+0000 7fd3b27fc640 1 -- 172.21.15.106:0/1646912953 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3b4059860 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.633+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3c0141160 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.634+0000 7fd3b27fc640 1 -- 172.21.15.106:0/1646912953 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fd3b405db60 con 0x7fd3c00bdfa0 2024-04-16T12:57:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:12.636 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 2 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd3a406c8f0 msgr2=0x7fd3a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd3a406c8f0 0x7fd3a406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3c01d4ee0 tx=0x7fd3bc008040 comp rx=0 tx=0).stop 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c00bdfa0 msgr2=0x7fd3c0145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c00bdfa0 0x7fd3c0145c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c7f0 tx=0x7fd3b400cbf0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 shutdown_connections 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd3a406c8f0 0x7fd3a406edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3c014b8d0 0x7fd3c01487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3c0142300 0x7fd3c00b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 --2- 172.21.15.106:0/1646912953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c00bdfa0 0x7fd3c0145c90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:12.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.635+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 >> 172.21.15.106:0/1646912953 conn(0x7fd3c0067dc0 msgr2=0x7fd3c00b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:12.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.636+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 shutdown_connections 2024-04-16T12:57:12.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:12.636+0000 7fd3c7c47640 1 -- 172.21.15.106:0/1646912953 wait complete. 2024-04-16T12:57:14.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:14.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.757+0000 7f85461db640 1 Processor -- start 2024-04-16T12:57:14.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.757+0000 7f85461db640 1 -- start start 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f85461db640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f854013fc00 0x7f85401513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f85461db640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8540067db0 con 0x7f8540149a20 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f85461db640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85400b0c70 con 0x7f85400679d0 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f85461db640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f85400afbf0 con 0x7f854013fc00 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f854013fc00 0x7f85401513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853effd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8540149a20 0x7f854013f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36308/0 (socket says 172.21.15.106:36308) 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f854013fc00 0x7f85401513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57970/0 (socket says 172.21.15.106:57970) 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853effd640 1 -- 172.21.15.106:0/1290941114 learned_addr learned my addr 172.21.15.106:0/1290941114 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853ffff640 1 -- 172.21.15.106:0/1290941114 >> v1:172.21.15.171:6789/0 conn(0x7f85400679d0 legacy=0x7f8540149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853ffff640 1 -- 172.21.15.106:0/1290941114 >> v1:172.21.15.106:6789/0 conn(0x7f8540149a20 legacy=0x7f854013f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853ffff640 1 -- 172.21.15.106:0/1290941114 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85400afed0 con 0x7f854013fc00 2024-04-16T12:57:14.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.758+0000 7f853e7fc640 1 -- 172.21.15.106:0/1290941114 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619101556 0 0) 0x7f8540067db0 con 0x7f8540149a20 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.759+0000 7f853ffff640 1 --2- 172.21.15.106:0/1290941114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854013fc00 0x7f85401513d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85380097a0 tx=0x7f853802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9560b905acdb8b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.759+0000 7f853e7fc640 1 -- 172.21.15.106:0/1290941114 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538035020 con 0x7f854013fc00 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.759+0000 7f853e7fc640 1 -- 172.21.15.106:0/1290941114 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8538031830 con 0x7f854013fc00 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.759+0000 7f853e7fc640 1 -- 172.21.15.106:0/1290941114 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538031c00 con 0x7f854013fc00 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.760+0000 7f85461db640 1 -- 172.21.15.106:0/1290941114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854013fc00 msgr2=0x7f85401513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.760+0000 7f85461db640 1 --2- 172.21.15.106:0/1290941114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854013fc00 0x7f85401513d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85380097a0 tx=0x7f853802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.760+0000 7f85461db640 1 -- 172.21.15.106:0/1290941114 shutdown_connections 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.760+0000 7f85461db640 1 --2- 172.21.15.106:0/1290941114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854013fc00 0x7f85401513d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.760+0000 7f85461db640 1 -- 172.21.15.106:0/1290941114 >> 172.21.15.106:0/1290941114 conn(0x7f85400b9ca0 msgr2=0x7f85400ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.760+0000 7f85461db640 1 -- 172.21.15.106:0/1290941114 shutdown_connections 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.760+0000 7f85461db640 1 -- 172.21.15.106:0/1290941114 wait complete. 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.761+0000 7f85461db640 1 Processor -- start 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.761+0000 7f85461db640 1 -- start start 2024-04-16T12:57:14.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85400679d0 0x7f85401463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f854013fc00 0x7f8540140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540149a20 0x7f8540141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f85401400b0 con 0x7f8540149a20 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85400b0990 con 0x7f85400679d0 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f85400b0360 con 0x7f854013fc00 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540149a20 0x7f8540141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540149a20 0x7f8540141350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57980/0 (socket says 172.21.15.106:57980) 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 -- 172.21.15.106:0/4010585653 learned_addr learned my addr 172.21.15.106:0/4010585653 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853f7fe640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85400679d0 0x7f85401463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853effd640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f854013fc00 0x7f8540140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 -- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f854013fc00 msgr2=0x7f8540140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f854013fc00 0x7f8540140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 -- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85400679d0 msgr2=0x7f85401463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85400679d0 0x7f85401463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 -- 172.21.15.106:0/4010585653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85401428b0 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853effd640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f854013fc00 0x7f8540140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f853ffff640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540149a20 0x7f8540141350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85380097a0 tx=0x7f85380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f8527fff640 1 -- 172.21.15.106:0/4010585653 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538004230 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f8527fff640 1 -- 172.21.15.106:0/4010585653 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85380043f0 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f8527fff640 1 -- 172.21.15.106:0/4010585653 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853803c9d0 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8540142f30 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.762+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85401425d0 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.763+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85400af910 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.764+0000 7f8527fff640 1 -- 172.21.15.106:0/4010585653 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8538038020 con 0x7f8540149a20 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.764+0000 7f8527fff640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f852c06c8f0 0x7f852c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:14.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.764+0000 7f8527fff640 1 -- 172.21.15.106:0/4010585653 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f85380ad930 con 0x7f8540149a20 2024-04-16T12:57:14.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.764+0000 7f853f7fe640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f852c06c8f0 0x7f852c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:14.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.765+0000 7f853f7fe640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f852c06c8f0 0x7f852c06edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8530005660 tx=0x7f8530003d90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:14.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.769+0000 7f8527fff640 1 -- 172.21.15.106:0/4010585653 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f85400af910 con 0x7f8540149a20 2024-04-16T12:57:14.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.980+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8540149eb0 con 0x7f8540149a20 2024-04-16T12:57:14.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.981+0000 7f8527fff640 1 -- 172.21.15.106:0/4010585653 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2222 (secure 0 0 0) 0x7f8540149eb0 con 0x7f8540149a20 2024-04-16T12:57:14.983 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:14.983 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-16T12:57:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 3 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f852c06c8f0 msgr2=0x7f852c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f852c06c8f0 0x7f852c06edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8530005660 tx=0x7f8530003d90 comp rx=0 tx=0).stop 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540149a20 msgr2=0x7f8540141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540149a20 0x7f8540141350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85380097a0 tx=0x7f85380046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 shutdown_connections 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f852c06c8f0 0x7f852c06edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540149a20 0x7f8540141350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f854013fc00 0x7f8540140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 --2- 172.21.15.106:0/4010585653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85400679d0 0x7f85401463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 >> 172.21.15.106:0/4010585653 conn(0x7f85400b9ca0 msgr2=0x7f85400b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 shutdown_connections 2024-04-16T12:57:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:14.983+0000 7f85461db640 1 -- 172.21.15.106:0/4010585653 wait complete. 2024-04-16T12:57:14.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:15.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.096+0000 7f17fe635640 1 Processor -- start 2024-04-16T12:57:15.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.096+0000 7f17fe635640 1 -- start start 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17fe635640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17f80bbf70 0x7f17f8147d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17fe635640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f80bc350 con 0x7f17f8070750 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17fe635640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f806f760 con 0x7f17f8148260 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17fe635640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f17f806fa40 con 0x7f17f80bbf70 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17f7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17f80bbf70 0x7f17f8147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17fcbd2640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f17f8070750 0x7f17f8152600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36316/0 (socket says 172.21.15.106:36316) 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17fcbd2640 1 -- 172.21.15.106:0/3986218539 learned_addr learned my addr 172.21.15.106:0/3986218539 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17f7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17f80bbf70 0x7f17f8147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57996/0 (socket says 172.21.15.106:57996) 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17f7fff640 1 -- 172.21.15.106:0/3986218539 >> v1:172.21.15.171:6789/0 conn(0x7f17f8148260 legacy=0x7f17f8144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17f7fff640 1 -- 172.21.15.106:0/3986218539 >> v1:172.21.15.106:6789/0 conn(0x7f17f8070750 legacy=0x7f17f8152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.097+0000 7f17f7fff640 1 -- 172.21.15.106:0/3986218539 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f80b6220 con 0x7f17f80bbf70 2024-04-16T12:57:15.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.098+0000 7f17f7fff640 1 --2- 172.21.15.106:0/3986218539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f80bbf70 0x7f17f8147d20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17e80097a0 tx=0x7f17e802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18db7cb000407606 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.098+0000 7f17f77fe640 1 -- 172.21.15.106:0/3986218539 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8038070 con 0x7f17f80bbf70 2024-04-16T12:57:15.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.098+0000 7f17f77fe640 1 -- 172.21.15.106:0/3986218539 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e8031700 con 0x7f17f80bbf70 2024-04-16T12:57:15.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.098+0000 7f17f77fe640 1 -- 172.21.15.106:0/3986218539 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8031ad0 con 0x7f17f80bbf70 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.099+0000 7f17fe635640 1 -- 172.21.15.106:0/3986218539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f80bbf70 msgr2=0x7f17f8147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.099+0000 7f17fe635640 1 --2- 172.21.15.106:0/3986218539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f80bbf70 0x7f17f8147d20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17e80097a0 tx=0x7f17e802b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.099+0000 7f17fe635640 1 -- 172.21.15.106:0/3986218539 shutdown_connections 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.099+0000 7f17fe635640 1 --2- 172.21.15.106:0/3986218539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f80bbf70 0x7f17f8147d20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.099+0000 7f17fe635640 1 -- 172.21.15.106:0/3986218539 >> 172.21.15.106:0/3986218539 conn(0x7f17f809aa60 msgr2=0x7f17f80bb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.099+0000 7f17fe635640 1 -- 172.21.15.106:0/3986218539 shutdown_connections 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.099+0000 7f17fe635640 1 -- 172.21.15.106:0/3986218539 wait complete. 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.100+0000 7f17fe635640 1 Processor -- start 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.100+0000 7f17fe635640 1 -- start start 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f8070750 0x7f17f80b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17f80bbf70 0x7f17f81d1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f8148260 0x7f17f81ddb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f17f809aff0 con 0x7f17f8070750 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17f809ae70 con 0x7f17f8148260 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17f80b6740 con 0x7f17f80bbf70 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f8070750 0x7f17f80b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f8070750 0x7f17f80b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57998/0 (socket says 172.21.15.106:57998) 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 -- 172.21.15.106:0/3030581480 learned_addr learned my addr 172.21.15.106:0/3030581480 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17effff640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17f80bbf70 0x7f17f81d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fcbd2640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f8148260 0x7f17f81ddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 -- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17f80bbf70 msgr2=0x7f17f81d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17f80bbf70 0x7f17f81d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 -- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f8148260 msgr2=0x7f17f81ddb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f8148260 0x7f17f81ddb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 -- 172.21.15.106:0/3030581480 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f80b2620 con 0x7f17f8070750 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f7fff640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f8070750 0x7f17f80b1ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098c0 tx=0x7f17e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f57fa640 1 -- 172.21.15.106:0/3030581480 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8043070 con 0x7f17f8070750 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f57fa640 1 -- 172.21.15.106:0/3030581480 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e8033a30 con 0x7f17f8070750 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f80b2900 con 0x7f17f8070750 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17f57fa640 1 -- 172.21.15.106:0/3030581480 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8038040 con 0x7f17f8070750 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.101+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f81d1990 con 0x7f17f8070750 2024-04-16T12:57:15.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.102+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f8068a90 con 0x7f17f8070750 2024-04-16T12:57:15.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.103+0000 7f17f57fa640 1 -- 172.21.15.106:0/3030581480 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17e8046070 con 0x7f17f8070750 2024-04-16T12:57:15.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.103+0000 7f17f57fa640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f17d806c8f0 0x7f17d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.104+0000 7f17effff640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f17d806c8f0 0x7f17d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.104+0000 7f17f57fa640 1 -- 172.21.15.106:0/3030581480 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f17e80ad5c0 con 0x7f17f8070750 2024-04-16T12:57:15.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.104+0000 7f17effff640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f17d806c8f0 0x7f17d806edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17f806e730 tx=0x7f17e0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.108+0000 7f17f57fa640 1 -- 172.21.15.106:0/3030581480 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17e8030070 con 0x7f17f8070750 2024-04-16T12:57:15.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.282+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17f80a07a0 con 0x7f17f8070750 2024-04-16T12:57:15.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.283+0000 7f17f57fa640 1 -- 172.21.15.106:0/3030581480 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f17e807bef0 con 0x7f17f8070750 2024-04-16T12:57:15.285 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:08.249649+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f17d806c8f0 msgr2=0x7f17d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f17d806c8f0 0x7f17d806edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17f806e730 tx=0x7f17e0009040 comp rx=0 tx=0).stop 2024-04-16T12:57:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f8070750 msgr2=0x7f17f80b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f8070750 0x7f17f80b1ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098c0 tx=0x7f17e80046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 shutdown_connections 2024-04-16T12:57:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f17d806c8f0 0x7f17d806edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f8148260 0x7f17f81ddb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17f80bbf70 0x7f17f81d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 --2- 172.21.15.106:0/3030581480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17f8070750 0x7f17f80b1ed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 >> 172.21.15.106:0/3030581480 conn(0x7f17f809aa60 msgr2=0x7f17f806dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 shutdown_connections 2024-04-16T12:57:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.285+0000 7f17fe635640 1 -- 172.21.15.106:0/3030581480 wait complete. 2024-04-16T12:57:15.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:15.298 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:15.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f90361ba640 1 Processor -- start 2024-04-16T12:57:15.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f90361ba640 1 -- start start 2024-04-16T12:57:15.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f90361ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90300b5480 0x7f903006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f90361ba640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f903006e7a0 0x7f903014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f90361ba640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90300b5860 con 0x7f903006d5c0 2024-04-16T12:57:15.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f90361ba640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f903006cac0 con 0x7f903006e7a0 2024-04-16T12:57:15.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f90361ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f90300b7680 con 0x7f90300b5480 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f902ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f903006e7a0 0x7f903014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f902ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f903006e7a0 0x7f903014bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58000/0 (socket says 172.21.15.106:58000) 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.402+0000 7f902ffff640 1 -- 172.21.15.106:0/1015883343 learned_addr learned my addr 172.21.15.106:0/1015883343 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.403+0000 7f902f7fe640 1 --2- 172.21.15.106:0/1015883343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90300b5480 0x7f903006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.403+0000 7f902ffff640 1 -- 172.21.15.106:0/1015883343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90300b5480 msgr2=0x7f903006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.403+0000 7f902ffff640 1 --2- 172.21.15.106:0/1015883343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90300b5480 0x7f903006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.403+0000 7f902ffff640 1 -- 172.21.15.106:0/1015883343 >> v1:172.21.15.171:6789/0 conn(0x7f903006d5c0 legacy=0x7f903014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.403+0000 7f902ffff640 1 -- 172.21.15.106:0/1015883343 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903006daf0 con 0x7f903006e7a0 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.403+0000 7f902ffff640 1 --2- 172.21.15.106:0/1015883343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f903014bbc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9028009870 tx=0x7f902802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88266ee885df5fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f902e7fc640 1 -- 172.21.15.106:0/1015883343 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028038070 con 0x7f903006e7a0 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f902e7fc640 1 -- 172.21.15.106:0/1015883343 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9028031740 con 0x7f903006e7a0 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f902e7fc640 1 -- 172.21.15.106:0/1015883343 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902802f050 con 0x7f903006e7a0 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 -- 172.21.15.106:0/1015883343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 msgr2=0x7f903014bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 --2- 172.21.15.106:0/1015883343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f903014bbc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9028009870 tx=0x7f902802b7e0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 -- 172.21.15.106:0/1015883343 shutdown_connections 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 --2- 172.21.15.106:0/1015883343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f903014bbc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 --2- 172.21.15.106:0/1015883343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90300b5480 0x7f903006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 -- 172.21.15.106:0/1015883343 >> 172.21.15.106:0/1015883343 conn(0x7f90300bb4e0 msgr2=0x7f90300bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 -- 172.21.15.106:0/1015883343 shutdown_connections 2024-04-16T12:57:15.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.404+0000 7f90361ba640 1 -- 172.21.15.106:0/1015883343 wait complete. 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.405+0000 7f90361ba640 1 Processor -- start 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.405+0000 7f90361ba640 1 -- start start 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f90361ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903006d5c0 0x7f90301e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f90361ba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f9030144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f90361ba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90300b5480 0x7f90301d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f90361ba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f90300b2570 con 0x7f903006e7a0 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f90361ba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f90300bc000 con 0x7f90300b5480 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f90361ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f903014c100 con 0x7f903006d5c0 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f9030144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f9030144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58010/0 (socket says 172.21.15.106:58010) 2024-04-16T12:57:15.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 -- 172.21.15.106:0/785984654 learned_addr learned my addr 172.21.15.106:0/785984654 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902f7fe640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903006d5c0 0x7f90301e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902ffff640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90300b5480 0x7f90301d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 -- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903006d5c0 msgr2=0x7f90301e0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903006d5c0 0x7f90301e0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 -- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90300b5480 msgr2=0x7f90301d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90300b5480 0x7f90301d1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 -- 172.21.15.106:0/785984654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90301440c0 con 0x7f903006e7a0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.406+0000 7f902effd640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f9030144e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f901800c430 tx=0x7f901800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.407+0000 7f9027fff640 1 -- 172.21.15.106:0/785984654 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018011790 con 0x7f903006e7a0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.407+0000 7f9027fff640 1 -- 172.21.15.106:0/785984654 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9018017070 con 0x7f903006e7a0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.407+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90301d31c0 con 0x7f903006e7a0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.407+0000 7f9027fff640 1 -- 172.21.15.106:0/785984654 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018011b70 con 0x7f903006e7a0 2024-04-16T12:57:15.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.407+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90301454e0 con 0x7f903006e7a0 2024-04-16T12:57:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.408+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9030068a90 con 0x7f903006e7a0 2024-04-16T12:57:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.408+0000 7f9027fff640 1 -- 172.21.15.106:0/785984654 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9018011d10 con 0x7f903006e7a0 2024-04-16T12:57:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.408+0000 7f9027fff640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f901006c920 0x7f901006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.408+0000 7f902f7fe640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f901006c920 0x7f901006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.408+0000 7f9027fff640 1 -- 172.21.15.106:0/785984654 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f901808b560 con 0x7f903006e7a0 2024-04-16T12:57:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.409+0000 7f902f7fe640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f901006c920 0x7f901006ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9020008e50 tx=0x7f90200083a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.413+0000 7f9027fff640 1 -- 172.21.15.106:0/785984654 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9018059d70 con 0x7f903006e7a0 2024-04-16T12:57:15.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.586+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90300b4a00 con 0x7f903006e7a0 2024-04-16T12:57:15.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.586+0000 7f9027fff640 1 -- 172.21.15.106:0/785984654 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f9018059670 con 0x7f903006e7a0 2024-04-16T12:57:15.588 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:15.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f901006c920 msgr2=0x7f901006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f901006c920 0x7f901006ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9020008e50 tx=0x7f90200083a0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 msgr2=0x7f9030144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f9030144e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f901800c430 tx=0x7f901800c8f0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 shutdown_connections 2024-04-16T12:57:15.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f901006c920 0x7f901006ede0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90300b5480 0x7f90301d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903006e7a0 0x7f9030144e50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 --2- 172.21.15.106:0/785984654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903006d5c0 0x7f90301e0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 >> 172.21.15.106:0/785984654 conn(0x7f90300bb4e0 msgr2=0x7f90300ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:15.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 shutdown_connections 2024-04-16T12:57:15.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.588+0000 7f90361ba640 1 -- 172.21.15.106:0/785984654 wait complete. 2024-04-16T12:57:15.601 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T12:57:15.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.701+0000 7fbf72c63640 1 Processor -- start 2024-04-16T12:57:15.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf72c63640 1 -- start start 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf72c63640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c0bbf70 0x7fbf6c147d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf72c63640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf6c070750 0x7fbf6c145410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf72c63640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf6c0bc350 con 0x7fbf6c148260 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf72c63640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fbf6c06fa40 con 0x7fbf6c070750 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf72c63640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6c06f760 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf71200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf6c070750 0x7fbf6c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf63fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbf6c148260 0x7fbf6c144d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36326/0 (socket says 172.21.15.106:36326) 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.702+0000 7fbf63fff640 1 -- 172.21.15.106:0/4239484642 learned_addr learned my addr 172.21.15.106:0/4239484642 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.703+0000 7fbf709ff640 1 --2- 172.21.15.106:0/4239484642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c0bbf70 0x7fbf6c147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.703+0000 7fbf71200640 1 -- 172.21.15.106:0/4239484642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c0bbf70 msgr2=0x7fbf6c147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.703+0000 7fbf71200640 1 --2- 172.21.15.106:0/4239484642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c0bbf70 0x7fbf6c147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.703+0000 7fbf71200640 1 -- 172.21.15.106:0/4239484642 >> v1:172.21.15.106:6789/0 conn(0x7fbf6c148260 legacy=0x7fbf6c144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.703+0000 7fbf637fe640 1 -- 172.21.15.106:0/4239484642 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637461160 0 0) 0x7fbf6c0bc350 con 0x7fbf6c148260 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.703+0000 7fbf71200640 1 -- 172.21.15.106:0/4239484642 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c0b6220 con 0x7fbf6c070750 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.703+0000 7fbf71200640 1 --2- 172.21.15.106:0/4239484642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c070750 0x7fbf6c145410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009d90 tx=0x7fbf6402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f31b26412c9cd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf637fe640 1 -- 172.21.15.106:0/4239484642 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64039070 con 0x7fbf6c070750 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf637fe640 1 -- 172.21.15.106:0/4239484642 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6402cb30 con 0x7fbf6c070750 2024-04-16T12:57:15.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf637fe640 1 -- 172.21.15.106:0/4239484642 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64034440 con 0x7fbf6c070750 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 -- 172.21.15.106:0/4239484642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c070750 msgr2=0x7fbf6c145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 --2- 172.21.15.106:0/4239484642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c070750 0x7fbf6c145410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009d90 tx=0x7fbf6402bd80 comp rx=0 tx=0).stop 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 -- 172.21.15.106:0/4239484642 shutdown_connections 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 --2- 172.21.15.106:0/4239484642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c070750 0x7fbf6c145410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 --2- 172.21.15.106:0/4239484642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c0bbf70 0x7fbf6c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 -- 172.21.15.106:0/4239484642 >> 172.21.15.106:0/4239484642 conn(0x7fbf6c09aa60 msgr2=0x7fbf6c0bb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 -- 172.21.15.106:0/4239484642 shutdown_connections 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.704+0000 7fbf72c63640 1 -- 172.21.15.106:0/4239484642 wait complete. 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.705+0000 7fbf72c63640 1 Processor -- start 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.705+0000 7fbf72c63640 1 -- start start 2024-04-16T12:57:15.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf72c63640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c070750 0x7fbf6c09f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf72c63640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c0bbf70 0x7fbf6c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf72c63640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c148260 0x7fbf6c0b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf72c63640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c09aff0 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf72c63640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c09ae70 con 0x7fbf6c070750 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf72c63640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6c0b6740 con 0x7fbf6c148260 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c0bbf70 0x7fbf6c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c0bbf70 0x7fbf6c0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58026/0 (socket says 172.21.15.106:58026) 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 -- 172.21.15.106:0/3848379244 learned_addr learned my addr 172.21.15.106:0/3848379244 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf71200640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c148260 0x7fbf6c0b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf709ff640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c070750 0x7fbf6c09f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 -- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c148260 msgr2=0x7fbf6c0b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c148260 0x7fbf6c0b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 -- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c070750 msgr2=0x7fbf6c09f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c070750 0x7fbf6c09f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf63fff640 1 -- 172.21.15.106:0/3848379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c1e06f0 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.706+0000 7fbf709ff640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c070750 0x7fbf6c09f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.707+0000 7fbf63fff640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c0bbf70 0x7fbf6c0b5220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00c410 tx=0x7fbf5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.707+0000 7fbf617fa640 1 -- 172.21.15.106:0/3848379244 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0074e0 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.707+0000 7fbf617fa640 1 -- 172.21.15.106:0/3848379244 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5c0047e0 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.707+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c0b4680 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.707+0000 7fbf617fa640 1 -- 172.21.15.106:0/3848379244 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c004bd0 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.707+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c0b33f0 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.708+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6c068a90 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.708+0000 7fbf617fa640 1 -- 172.21.15.106:0/3848379244 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf5c011070 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.709+0000 7fbf617fa640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbf5806c8f0 0x7fbf5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:15.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.709+0000 7fbf617fa640 1 -- 172.21.15.106:0/3848379244 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fbf5c08b350 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.709+0000 7fbf709ff640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbf5806c8f0 0x7fbf5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:15.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.709+0000 7fbf709ff640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbf5806c8f0 0x7fbf5806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009ac0 tx=0x7fbf68008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:15.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.713+0000 7fbf617fa640 1 -- 172.21.15.106:0/3848379244 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf5c00e280 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.891+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbf6c0b4960 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.891+0000 7fbf617fa640 1 -- 172.21.15.106:0/3848379244 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fbf5c059b60 con 0x7fbf6c0bbf70 2024-04-16T12:57:15.893 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:15.893 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-04-16T12:57:15.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:15.894 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2024-04-16T12:57:15.894 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2024-04-16T12:57:15.894 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:15.894 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-04-16T12:57:15.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbf5806c8f0 msgr2=0x7fbf5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbf5806c8f0 0x7fbf5806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009ac0 tx=0x7fbf68008040 comp rx=0 tx=0).stop 2024-04-16T12:57:15.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c0bbf70 msgr2=0x7fbf6c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:15.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c0bbf70 0x7fbf6c0b5220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00c410 tx=0x7fbf5c00c8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 shutdown_connections 2024-04-16T12:57:15.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbf5806c8f0 0x7fbf5806edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf6c148260 0x7fbf6c0b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf6c0bbf70 0x7fbf6c0b5220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 --2- 172.21.15.106:0/3848379244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c070750 0x7fbf6c09f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:15.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 >> 172.21.15.106:0/3848379244 conn(0x7fbf6c09aa60 msgr2=0x7fbf6c1467c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:15.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 shutdown_connections 2024-04-16T12:57:15.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:15.893+0000 7fbf72c63640 1 -- 172.21.15.106:0/3848379244 wait complete. 2024-04-16T12:57:15.906 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T12:57:15.906 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T12:57:16.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.010+0000 7fdab16fb640 1 Processor -- start 2024-04-16T12:57:16.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdab16fb640 1 -- start start 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdab16fb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdab16fb640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdaac0b7f40 0x7fdaac148700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdab16fb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaac0b75f0 con 0x7fdaac0b58b0 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdab16fb640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fdaac0b7860 con 0x7fdaac0b7f40 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdab16fb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdaac148c40 con 0x7fdaac0b68d0 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdaab7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdaac0b7f40 0x7fdaac148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdaab7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdaac0b7f40 0x7fdaac148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58032/0 (socket says 172.21.15.106:58032) 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.011+0000 7fdaab7fe640 1 -- 172.21.15.106:0/2364082270 learned_addr learned my addr 172.21.15.106:0/2364082270 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaaa7fc640 1 --2- 172.21.15.106:0/2364082270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaab7fe640 1 -- 172.21.15.106:0/2364082270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 msgr2=0x7fdaac141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaab7fe640 1 --2- 172.21.15.106:0/2364082270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaab7fe640 1 -- 172.21.15.106:0/2364082270 >> v1:172.21.15.171:6789/0 conn(0x7fdaac0b58b0 legacy=0x7fdaac1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaab7fe640 1 -- 172.21.15.106:0/2364082270 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac0b5c90 con 0x7fdaac0b7f40 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaab7fe640 1 --2- 172.21.15.106:0/2364082270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac148700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098a0 tx=0x7fdaa402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2be167390893f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaa9ffb640 1 -- 172.21.15.106:0/2364082270 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4038070 con 0x7fdaac0b7f40 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaa9ffb640 1 -- 172.21.15.106:0/2364082270 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa4031520 con 0x7fdaac0b7f40 2024-04-16T12:57:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.012+0000 7fdaa9ffb640 1 -- 172.21.15.106:0/2364082270 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40318f0 con 0x7fdaac0b7f40 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 -- 172.21.15.106:0/2364082270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 msgr2=0x7fdaac148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 --2- 172.21.15.106:0/2364082270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac148700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098a0 tx=0x7fdaa402b7c0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 -- 172.21.15.106:0/2364082270 shutdown_connections 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 --2- 172.21.15.106:0/2364082270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac148700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 --2- 172.21.15.106:0/2364082270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 -- 172.21.15.106:0/2364082270 >> 172.21.15.106:0/2364082270 conn(0x7fdaac067760 msgr2=0x7fdaac067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 -- 172.21.15.106:0/2364082270 shutdown_connections 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.013+0000 7fdab16fb640 1 -- 172.21.15.106:0/2364082270 wait complete. 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.014+0000 7fdab16fb640 1 Processor -- start 2024-04-16T12:57:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.014+0000 7fdab16fb640 1 -- start start 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdab16fb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0b58b0 0x7fdaac144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdab16fb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac1dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdab16fb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac13a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdab16fb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac147f00 con 0x7fdaac0b7f40 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdab16fb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac0b5060 con 0x7fdaac0b58b0 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdab16fb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdaac1481e0 con 0x7fdaac0b68d0 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac13a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac13a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58042/0 (socket says 172.21.15.106:58042) 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 -- 172.21.15.106:0/15584277 learned_addr learned my addr 172.21.15.106:0/15584277 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaaa7fc640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac1dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaaaffd640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0b58b0 0x7fdaac144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 -- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 msgr2=0x7fdaac1dd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac1dd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 -- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0b58b0 msgr2=0x7fdaac144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0b58b0 0x7fdaac144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 -- 172.21.15.106:0/15584277 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac1cfe50 con 0x7fdaac0b7f40 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaaa7fc640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac1dd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fdaab7fe640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac13a8a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098a0 tx=0x7fdaa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fda937fe640 1 -- 172.21.15.106:0/15584277 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4042070 con 0x7fdaac0b7f40 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.015+0000 7fda937fe640 1 -- 172.21.15.106:0/15584277 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa403d870 con 0x7fdaac0b7f40 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.016+0000 7fda937fe640 1 -- 172.21.15.106:0/15584277 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4038040 con 0x7fdaac0b7f40 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.016+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaac1d36b0 con 0x7fdaac0b7f40 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.016+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaac1cdd20 con 0x7fdaac0b7f40 2024-04-16T12:57:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.016+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaac068a90 con 0x7fdaac0b7f40 2024-04-16T12:57:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.017+0000 7fda937fe640 1 -- 172.21.15.106:0/15584277 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdaa4045070 con 0x7fdaac0b7f40 2024-04-16T12:57:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.017+0000 7fda937fe640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fda9806c8f0 0x7fda9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.018+0000 7fdaaaffd640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fda9806c8f0 0x7fda9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.018+0000 7fda937fe640 1 -- 172.21.15.106:0/15584277 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdaa40ad220 con 0x7fdaac0b7f40 2024-04-16T12:57:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.018+0000 7fdaaaffd640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fda9806c8f0 0x7fda9806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdaac1e1c20 tx=0x7fda9c003d90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:16.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.022+0000 7fda937fe640 1 -- 172.21.15.106:0/15584277 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdaa407b500 con 0x7fdaac0b7f40 2024-04-16T12:57:16.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.198+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdaac145660 con 0x7fdaac0b7f40 2024-04-16T12:57:16.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.874+0000 7fda937fe640 1 -- 172.21.15.106:0/15584277 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fdaa407f800 con 0x7fdaac0b7f40 2024-04-16T12:57:16.876 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2024-04-16T12:57:16.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fda9806c8f0 msgr2=0x7fda9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:16.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fda9806c8f0 0x7fda9806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdaac1e1c20 tx=0x7fda9c003d90 comp rx=0 tx=0).stop 2024-04-16T12:57:16.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 msgr2=0x7fdaac13a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:16.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac13a8a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098a0 tx=0x7fdaa40046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 shutdown_connections 2024-04-16T12:57:16.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fda9806c8f0 0x7fda9806edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0b7f40 0x7fdaac13a8a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac0b68d0 0x7fdaac1dd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 --2- 172.21.15.106:0/15584277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0b58b0 0x7fdaac144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:16.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 >> 172.21.15.106:0/15584277 conn(0x7fdaac067760 msgr2=0x7fdaac13dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:16.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 shutdown_connections 2024-04-16T12:57:16.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:16.876+0000 7fdab16fb640 1 -- 172.21.15.106:0/15584277 wait complete. 2024-04-16T12:57:16.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T12:57:17.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.001+0000 7f22da4ba640 1 Processor -- start 2024-04-16T12:57:17.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.001+0000 7f22da4ba640 1 -- start start 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.001+0000 7f22da4ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 0x7f22d4148040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22da4ba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d40b6950 con 0x7f22d40b4e30 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22da4ba640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d4148aa0 con 0x7f22d4148580 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22da4ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22d4148d80 con 0x7f22d40b6570 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d8a57640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f22d40b4e30 0x7f22d40b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36336/0 (socket says 172.21.15.106:36336) 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d8a57640 1 -- 172.21.15.106:0/3624291445 learned_addr learned my addr 172.21.15.106:0/3624291445 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d3fff640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 0x7f22d4148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489651107 0 0) 0x7f22d40b6950 con 0x7f22d40b4e30 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22bc003520 con 0x7f22d40b4e30 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 557041872 0 0) 0x7f22bc003520 con 0x7f22d40b4e30 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 msgr2=0x7f22d4148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 0x7f22d4148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 >> v1:172.21.15.171:6789/0 conn(0x7f22d4148580 legacy=0x7f22d413e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40b0ee0 con 0x7f22d40b4e30 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f22cc0019f0 con 0x7f22d40b4e30 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 >> v1:172.21.15.106:6789/0 conn(0x7f22d40b4e30 legacy=0x7f22d40b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22bc0039e0 0x7f22bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22bc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 0x7f22bc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4148d80 con 0x7f22bc004390 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc00ba70 con 0x7f22bc0039e0 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc00bc70 con 0x7f22d40b6570 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d37fe640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22bc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d3fff640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22bc0039e0 0x7f22bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.002+0000 7f22d8a57640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 0x7f22bc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d37fe640 1 -- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 msgr2=0x7f22bc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:17.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d37fe640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 0x7f22bc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d37fe640 1 -- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22bc0039e0 msgr2=0x7f22bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d37fe640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22bc0039e0 0x7f22bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d37fe640 1 -- 172.21.15.106:0/3624291445 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc003520 con 0x7f22bc004390 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d8a57640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40b6570 0x7f22bc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d37fe640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22bc004860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22c80018b0 tx=0x7f22bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4985d5de3d21be2f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.003+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8038070 con 0x7f22bc004390 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8033410 con 0x7f22bc004390 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22d2ffd640 1 -- 172.21.15.106:0/3624291445 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8001480 con 0x7f22bc004390 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22da4ba640 1 -- 172.21.15.106:0/3624291445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 msgr2=0x7f22bc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22da4ba640 1 --2- 172.21.15.106:0/3624291445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22bc004860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22c80018b0 tx=0x7f22bc005830 comp rx=0 tx=0).stop 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22d8a57640 1 -- 172.21.15.106:0/3624291445 reap_dead start 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22da4ba640 1 -- 172.21.15.106:0/3624291445 shutdown_connections 2024-04-16T12:57:17.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22da4ba640 1 -- 172.21.15.106:0/3624291445 >> 172.21.15.106:0/3624291445 conn(0x7f22d40bd690 msgr2=0x7f22d40bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:17.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22da4ba640 1 -- 172.21.15.106:0/3624291445 shutdown_connections 2024-04-16T12:57:17.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.004+0000 7f22da4ba640 1 -- 172.21.15.106:0/3624291445 wait complete. 2024-04-16T12:57:17.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.005+0000 7f22da4ba640 1 Processor -- start 2024-04-16T12:57:17.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.005+0000 7f22da4ba640 1 -- start start 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22da4ba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22d41cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22da4ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d41ce5a0 0x7f22d41454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22da4ba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d41e0840 0x7f22d41e0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22da4ba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f22d41481c0 con 0x7f22bc004390 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22da4ba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4148040 con 0x7f22d41e0840 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22da4ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22d4148340 con 0x7f22d41ce5a0 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22d41cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22d41cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58054/0 (socket says 172.21.15.106:58054) 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 -- 172.21.15.106:0/2587574028 learned_addr learned my addr 172.21.15.106:0/2587574028 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d37fe640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d41ce5a0 0x7f22d41454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d8a57640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d41e0840 0x7f22d41e0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 -- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d41ce5a0 msgr2=0x7f22d41454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d41ce5a0 0x7f22d41454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 -- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d41e0840 msgr2=0x7f22d41e0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d41e0840 0x7f22d41e0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 -- 172.21.15.106:0/2587574028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d41cfa50 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d8a57640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d41e0840 0x7f22d41e0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d37fe640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d41ce5a0 0x7f22d41454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.006+0000 7f22d3fff640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22d41cf340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22c40119a0 tx=0x7f22c4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.007+0000 7f22d0ff9640 1 -- 172.21.15.106:0/2587574028 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c400faf0 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.007+0000 7f22d0ff9640 1 -- 172.21.15.106:0/2587574028 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c400fc90 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.007+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d41cfd30 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.007+0000 7f22d0ff9640 1 -- 172.21.15.106:0/2587574028 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4014440 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.007+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d40b5240 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.008+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d4068a90 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.008+0000 7f22d0ff9640 1 -- 172.21.15.106:0/2587574028 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22c4012040 con 0x7f22bc004390 2024-04-16T12:57:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.009+0000 7f22d0ff9640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f22c006c8f0 0x7f22c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:17.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.009+0000 7f22d37fe640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f22c006c8f0 0x7f22c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:17.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.009+0000 7f22d0ff9640 1 -- 172.21.15.106:0/2587574028 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f22c408bfd0 con 0x7f22bc004390 2024-04-16T12:57:17.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.009+0000 7f22d37fe640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f22c006c8f0 0x7f22c006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22c8035000 tx=0x7f22c8005040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:17.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.013+0000 7f22d0ff9640 1 -- 172.21.15.106:0/2587574028 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22c4019030 con 0x7f22bc004390 2024-04-16T12:57:17.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.190+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f22d4075430 con 0x7f22bc004390 2024-04-16T12:57:17.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.879+0000 7f22d0ff9640 1 -- 172.21.15.106:0/2587574028 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f22c405a020 con 0x7f22bc004390 2024-04-16T12:57:17.881 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f22c006c8f0 msgr2=0x7f22c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f22c006c8f0 0x7f22c006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22c8035000 tx=0x7f22c8005040 comp rx=0 tx=0).stop 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 msgr2=0x7f22d41cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22d41cf340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22c40119a0 tx=0x7f22c4011e60 comp rx=0 tx=0).stop 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 shutdown_connections 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f22c006c8f0 0x7f22c006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d41e0840 0x7f22d41e0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d41ce5a0 0x7f22d41454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 --2- 172.21.15.106:0/2587574028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22bc004390 0x7f22d41cf340 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 >> 172.21.15.106:0/2587574028 conn(0x7f22d40bd690 msgr2=0x7f22d40bceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:17.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 shutdown_connections 2024-04-16T12:57:17.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:17.882+0000 7f22da4ba640 1 -- 172.21.15.106:0/2587574028 wait complete. 2024-04-16T12:57:17.906 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T12:57:18.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.014+0000 7f88ce635640 1 Processor -- start 2024-04-16T12:57:18.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.014+0000 7f88ce635640 1 -- start start 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88ce635640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88c80b63e0 0x7f88c80b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88ce635640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88c81486a0 0x7f88c8141a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88ce635640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c8141f70 0x7f88c814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88ce635640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f88c80b7610 con 0x7f88c80b63e0 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88ce635640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f88c80b67c0 con 0x7f88c81486a0 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88ce635640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88c80b5660 con 0x7f88c8141f70 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88c80b63e0 0x7f88c80b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88c80b63e0 0x7f88c80b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58066/0 (socket says 172.21.15.106:58066) 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 -- 172.21.15.106:0/1243025620 learned_addr learned my addr 172.21.15.106:0/1243025620 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88ccbd2640 1 --2- 172.21.15.106:0/1243025620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c8141f70 0x7f88c814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c77fe640 1 --2- 172.21.15.106:0/1243025620 >> v2:172.21.15.171:3300/0 conn(0x7f88c81486a0 0x7f88c8141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 -- 172.21.15.106:0/1243025620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c8141f70 msgr2=0x7f88c814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 --2- 172.21.15.106:0/1243025620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c8141f70 0x7f88c814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 -- 172.21.15.106:0/1243025620 >> v2:172.21.15.171:3300/0 conn(0x7f88c81486a0 msgr2=0x7f88c8141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 --2- 172.21.15.106:0/1243025620 >> v2:172.21.15.171:3300/0 conn(0x7f88c81486a0 0x7f88c8141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.015+0000 7f88c7fff640 1 -- 172.21.15.106:0/1243025620 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c80b59a0 con 0x7f88c80b63e0 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.016+0000 7f88c7fff640 1 --2- 172.21.15.106:0/1243025620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c80b63e0 0x7f88c80b6f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b7c40 tx=0x7f88b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d8559e0459f853 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.016+0000 7f88c6ffd640 1 -- 172.21.15.106:0/1243025620 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8035020 con 0x7f88c80b63e0 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.016+0000 7f88c6ffd640 1 -- 172.21.15.106:0/1243025620 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8031870 con 0x7f88c80b63e0 2024-04-16T12:57:18.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.016+0000 7f88c6ffd640 1 -- 172.21.15.106:0/1243025620 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8031c40 con 0x7f88c80b63e0 2024-04-16T12:57:18.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 -- 172.21.15.106:0/1243025620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c80b63e0 msgr2=0x7f88c80b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:18.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 --2- 172.21.15.106:0/1243025620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c80b63e0 0x7f88c80b6f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b7c40 tx=0x7f88b802b910 comp rx=0 tx=0).stop 2024-04-16T12:57:18.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 -- 172.21.15.106:0/1243025620 shutdown_connections 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 --2- 172.21.15.106:0/1243025620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c8141f70 0x7f88c814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 --2- 172.21.15.106:0/1243025620 >> v2:172.21.15.171:3300/0 conn(0x7f88c81486a0 0x7f88c8141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 --2- 172.21.15.106:0/1243025620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c80b63e0 0x7f88c80b6f00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 -- 172.21.15.106:0/1243025620 >> 172.21.15.106:0/1243025620 conn(0x7f88c80bd640 msgr2=0x7f88c80bda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 -- 172.21.15.106:0/1243025620 shutdown_connections 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.017+0000 7f88ce635640 1 -- 172.21.15.106:0/1243025620 wait complete. 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.018+0000 7f88ce635640 1 Processor -- start 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.018+0000 7f88ce635640 1 -- start start 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88c80b63e0 0x7f88c8142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8141f70 0x7f88c814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c81486a0 0x7f88c813c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8148c90 con 0x7f88c8141f70 2024-04-16T12:57:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8148b10 con 0x7f88c80b63e0 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88c80b7fc0 con 0x7f88c81486a0 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8141f70 0x7f88c814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8141f70 0x7f88c814b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58074/0 (socket says 172.21.15.106:58074) 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 -- 172.21.15.106:0/1113054591 learned_addr learned my addr 172.21.15.106:0/1113054591 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c7fff640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88c80b63e0 0x7f88c8142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ccbd2640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c81486a0 0x7f88c813c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 -- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c81486a0 msgr2=0x7f88c813c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c81486a0 0x7f88c813c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 -- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88c80b63e0 msgr2=0x7f88c8142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88c80b63e0 0x7f88c8142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 -- 172.21.15.106:0/1113054591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c81457a0 con 0x7f88c8141f70 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c77fe640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8141f70 0x7f88c814b2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00d620 tx=0x7f88bc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c4ff9640 1 -- 172.21.15.106:0/1113054591 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00b620 con 0x7f88c8141f70 2024-04-16T12:57:18.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c4ff9640 1 -- 172.21.15.106:0/1113054591 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88bc019070 con 0x7f88c8141f70 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88c4ff9640 1 -- 172.21.15.106:0/1113054591 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00ba00 con 0x7f88c8141f70 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c81d1ab0 con 0x7f88c8141f70 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.019+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c81427d0 con 0x7f88c8141f70 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.020+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c8068a90 con 0x7f88c8141f70 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.021+0000 7f88c4ff9640 1 -- 172.21.15.106:0/1113054591 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f88bc00bba0 con 0x7f88c8141f70 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.021+0000 7f88c4ff9640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f88b406c8f0 0x7f88b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.021+0000 7f88c4ff9640 1 -- 172.21.15.106:0/1113054591 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f88bc08bd40 con 0x7f88c8141f70 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.021+0000 7f88c7fff640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f88b406c8f0 0x7f88b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:18.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.022+0000 7f88c7fff640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f88b406c8f0 0x7f88b406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88b8036000 tx=0x7f88b803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:18.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.026+0000 7f88c4ff9640 1 -- 172.21.15.106:0/1113054591 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f88c81457a0 con 0x7f88c8141f70 2024-04-16T12:57:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.240+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f88c80b5210 con 0x7f88c8141f70 2024-04-16T12:57:18.657 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:18.660 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.888+0000 7f88c4ff9640 1 -- 172.21.15.106:0/1113054591 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f88bc059c10 con 0x7f88c8141f70 2024-04-16T12:57:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 2 and data pool 3 2024-04-16T12:57:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.895+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f88b406c8f0 msgr2=0x7f88b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.895+0000 7f88ce635640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f88b406c8f0 0x7f88b406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88b8036000 tx=0x7f88b803c040 comp rx=0 tx=0).stop 2024-04-16T12:57:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.895+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8141f70 msgr2=0x7f88c814b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.895+0000 7f88ce635640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8141f70 0x7f88c814b2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00d620 tx=0x7f88bc00dae0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.901+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 shutdown_connections 2024-04-16T12:57:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.901+0000 7f88ce635640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f88b406c8f0 0x7f88b406edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.901+0000 7f88ce635640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88c81486a0 0x7f88c813c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.901+0000 7f88ce635640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8141f70 0x7f88c814b2e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.901+0000 7f88ce635640 1 --2- 172.21.15.106:0/1113054591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88c80b63e0 0x7f88c8142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.901+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 >> 172.21.15.106:0/1113054591 conn(0x7f88c80bd640 msgr2=0x7f88c80bb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.903+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 shutdown_connections 2024-04-16T12:57:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:18.903+0000 7f88ce635640 1 -- 172.21.15.106:0/1113054591 wait complete. 2024-04-16T12:57:18.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:19.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc4a959640 1 Processor -- start 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc4a959640 1 -- start start 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc4a959640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcc440b63a0 0x7fcc440b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc4a959640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc44148b70 con 0x7fcc44148670 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc4a959640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc440b4bd0 con 0x7fcc441481c0 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc4a959640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcc440b4eb0 con 0x7fcc440b63a0 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc48ef6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcc44148670 0x7fcc440b53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36342/0 (socket says 172.21.15.106:36342) 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.025+0000 7fcc48ef6640 1 -- 172.21.15.106:0/2942641840 learned_addr learned my addr 172.21.15.106:0/2942641840 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040640610 0 0) 0x7fcc44148b70 con 0x7fcc44148670 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc2c003520 con 0x7fcc44148670 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc43fff640 1 --2- 172.21.15.106:0/2942641840 >> v2:172.21.15.171:3300/0 conn(0x7fcc440b63a0 0x7fcc440b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 500710691 0 0) 0x7fcc2c003520 con 0x7fcc44148670 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 >> v2:172.21.15.171:3300/0 conn(0x7fcc440b63a0 msgr2=0x7fcc440b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 --2- 172.21.15.106:0/2942641840 >> v2:172.21.15.171:3300/0 conn(0x7fcc440b63a0 0x7fcc440b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 >> v1:172.21.15.171:6789/0 conn(0x7fcc441481c0 legacy=0x7fcc441418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc44141fb0 con 0x7fcc44148670 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fcc3c0019f0 con 0x7fcc44148670 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 >> v1:172.21.15.106:6789/0 conn(0x7fcc44148670 legacy=0x7fcc440b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc2c004800 0x7fcc2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0051c0 0x7fcc2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcc440b4eb0 con 0x7fcc2c0039b0 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c00c160 con 0x7fcc2c0051c0 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2c00c360 con 0x7fcc2c004800 2024-04-16T12:57:19.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc43fff640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc437fe640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc2c004800 0x7fcc2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc48ef6640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0051c0 0x7fcc2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc43fff640 1 -- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc2c004800 msgr2=0x7fcc2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc43fff640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc2c004800 0x7fcc2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc43fff640 1 -- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0051c0 msgr2=0x7fcc2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc43fff640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0051c0 0x7fcc2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc43fff640 1 -- 172.21.15.106:0/2942641840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c003520 con 0x7fcc2c0039b0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.026+0000 7fcc48ef6640 1 -- 172.21.15.106:0/2942641840 reap_dead start 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.027+0000 7fcc43fff640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009ac0 tx=0x7fcc2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a593c3a87b7fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.027+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34039070 con 0x7fcc2c0039b0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.027+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3402c6b0 con 0x7fcc2c0039b0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.027+0000 7fcc42ffd640 1 -- 172.21.15.106:0/2942641840 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34009690 con 0x7fcc2c0039b0 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.028+0000 7fcc4a959640 1 -- 172.21.15.106:0/2942641840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c0039b0 msgr2=0x7fcc2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.028+0000 7fcc4a959640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009ac0 tx=0x7fcc2c005830 comp rx=0 tx=0).stop 2024-04-16T12:57:19.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.028+0000 7fcc4a959640 1 -- 172.21.15.106:0/2942641840 shutdown_connections 2024-04-16T12:57:19.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.028+0000 7fcc4a959640 1 --2- 172.21.15.106:0/2942641840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c0039b0 0x7fcc2c003dd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.028+0000 7fcc4a959640 1 -- 172.21.15.106:0/2942641840 >> 172.21.15.106:0/2942641840 conn(0x7fcc44068080 msgr2=0x7fcc440bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:19.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.028+0000 7fcc4a959640 1 -- 172.21.15.106:0/2942641840 shutdown_connections 2024-04-16T12:57:19.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.028+0000 7fcc4a959640 1 -- 172.21.15.106:0/2942641840 wait complete. 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.029+0000 7fcc4a959640 1 Processor -- start 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.029+0000 7fcc4a959640 1 -- start start 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0039b0 0x7fcc44144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc4414a270 0x7fcc4414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc4413bce0 0x7fcc4413c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcc440b6b10 con 0x7fcc4413bce0 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcc440b6990 con 0x7fcc2c0039b0 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc441418a0 con 0x7fcc4414a270 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc4413bce0 0x7fcc4413c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc4413bce0 0x7fcc4413c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58088/0 (socket says 172.21.15.106:58088) 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 -- 172.21.15.106:0/1182236032 learned_addr learned my addr 172.21.15.106:0/1182236032 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:19.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc43fff640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0039b0 0x7fcc44144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc437fe640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc4414a270 0x7fcc4414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 -- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc4414a270 msgr2=0x7fcc4414a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc4414a270 0x7fcc4414a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 -- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0039b0 msgr2=0x7fcc44144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0039b0 0x7fcc44144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 -- 172.21.15.106:0/1182236032 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4414ac30 con 0x7fcc4413bce0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc48ef6640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc4413bce0 0x7fcc4413c160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc44148aa0 tx=0x7fcc3c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc40ff9640 1 -- 172.21.15.106:0/1182236032 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00ab60 con 0x7fcc4413bce0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc40ff9640 1 -- 172.21.15.106:0/1182236032 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c018070 con 0x7fcc4413bce0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc441d1de0 con 0x7fcc4413bce0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc40ff9640 1 -- 172.21.15.106:0/1182236032 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0133f0 con 0x7fcc4413bce0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.030+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4414b7d0 con 0x7fcc4413bce0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.031+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc44068a90 con 0x7fcc4413bce0 2024-04-16T12:57:19.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.032+0000 7fcc40ff9640 1 -- 172.21.15.106:0/1182236032 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc3c013590 con 0x7fcc4413bce0 2024-04-16T12:57:19.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.032+0000 7fcc40ff9640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcc3006c8f0 0x7fcc3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.032+0000 7fcc40ff9640 1 -- 172.21.15.106:0/1182236032 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fcc3c08c060 con 0x7fcc4413bce0 2024-04-16T12:57:19.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.032+0000 7fcc43fff640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcc3006c8f0 0x7fcc3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.033+0000 7fcc43fff640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcc3006c8f0 0x7fcc3006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc34036000 tx=0x7fcc34030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.037+0000 7fcc40ff9640 1 -- 172.21.15.106:0/1182236032 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc4414ac30 con 0x7fcc4413bce0 2024-04-16T12:57:19.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.213+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc44147820 con 0x7fcc4413bce0 2024-04-16T12:57:19.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.214+0000 7fcc40ff9640 1 -- 172.21.15.106:0/1182236032 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7fcc3c05a520 con 0x7fcc4413bce0 2024-04-16T12:57:19.216 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:18.241758+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcc3006c8f0 msgr2=0x7fcc3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcc3006c8f0 0x7fcc3006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc34036000 tx=0x7fcc34030000 comp rx=0 tx=0).stop 2024-04-16T12:57:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc4413bce0 msgr2=0x7fcc4413c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc4413bce0 0x7fcc4413c160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc44148aa0 tx=0x7fcc3c007b00 comp rx=0 tx=0).stop 2024-04-16T12:57:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 shutdown_connections 2024-04-16T12:57:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcc3006c8f0 0x7fcc3006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc4413bce0 0x7fcc4413c160 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc4414a270 0x7fcc4414a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 --2- 172.21.15.106:0/1182236032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc2c0039b0 0x7fcc44144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 >> 172.21.15.106:0/1182236032 conn(0x7fcc44068080 msgr2=0x7fcc4413f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:19.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 shutdown_connections 2024-04-16T12:57:19.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.216+0000 7fcc4a959640 1 -- 172.21.15.106:0/1182236032 wait complete. 2024-04-16T12:57:19.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:19.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.332+0000 7ff17f31c640 1 Processor -- start 2024-04-16T12:57:19.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.332+0000 7ff17f31c640 1 -- start start 2024-04-16T12:57:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.332+0000 7ff17f31c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1780bbf70 0x7ff178147d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.332+0000 7ff17f31c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff178144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.332+0000 7ff17f31c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1780bc350 con 0x7ff178070750 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.332+0000 7ff17f31c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff17806fa40 con 0x7ff1780bbf70 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.332+0000 7ff17f31c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff17806f760 con 0x7ff178148260 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17c8b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff178144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d0b8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1780bbf70 0x7ff178147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d8b9640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff178070750 0x7ff178145240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:37710/0 (socket says 172.21.15.106:37710) 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d0b8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1780bbf70 0x7ff178147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:45632/0 (socket says 172.21.15.106:45632) 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17c8b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff178144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:57640/0 (socket says 172.21.15.106:57640) 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d8b9640 1 -- 172.21.15.106:0/1628407716 learned_addr learned my addr 172.21.15.106:0/1628407716 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d0b8640 1 -- 172.21.15.106:0/1628407716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 msgr2=0x7ff178144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d0b8640 1 --2- 172.21.15.106:0/1628407716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff178144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d0b8640 1 -- 172.21.15.106:0/1628407716 >> v1:172.21.15.171:6789/0 conn(0x7ff178070750 legacy=0x7ff178145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff177fff640 1 -- 172.21.15.106:0/1628407716 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89457485 0 0) 0x7ff1780bc350 con 0x7ff178070750 2024-04-16T12:57:19.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.333+0000 7ff17d0b8640 1 -- 172.21.15.106:0/1628407716 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1780b6220 con 0x7ff1780bbf70 2024-04-16T12:57:19.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.334+0000 7ff17d0b8640 1 --2- 172.21.15.106:0/1628407716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1780bbf70 0x7ff178147d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1680097a0 tx=0x7ff16802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f6a110d9b8532c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.334+0000 7ff177fff640 1 -- 172.21.15.106:0/1628407716 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168038070 con 0x7ff1780bbf70 2024-04-16T12:57:19.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.334+0000 7ff177fff640 1 -- 172.21.15.106:0/1628407716 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff168031700 con 0x7ff1780bbf70 2024-04-16T12:57:19.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.334+0000 7ff177fff640 1 -- 172.21.15.106:0/1628407716 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168031ad0 con 0x7ff1780bbf70 2024-04-16T12:57:19.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 -- 172.21.15.106:0/1628407716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1780bbf70 msgr2=0x7ff178147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1628407716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1780bbf70 0x7ff178147d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1680097a0 tx=0x7ff16802b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 -- 172.21.15.106:0/1628407716 shutdown_connections 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1628407716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff178144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1628407716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1780bbf70 0x7ff178147d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 -- 172.21.15.106:0/1628407716 >> 172.21.15.106:0/1628407716 conn(0x7ff17809aa60 msgr2=0x7ff1780bb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 -- 172.21.15.106:0/1628407716 shutdown_connections 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.335+0000 7ff17f31c640 1 -- 172.21.15.106:0/1628407716 wait complete. 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 Processor -- start 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 -- start start 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff178070750 0x7ff1780b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1780bbf70 0x7ff17809c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff17809b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff17809aff0 con 0x7ff1780bbf70 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff17809ae70 con 0x7ff178070750 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17f31c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1780b6740 con 0x7ff178148260 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17c8b7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1780bbf70 0x7ff17809c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.336+0000 7ff17c8b7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1780bbf70 0x7ff17809c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58094/0 (socket says 172.21.15.106:58094) 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17c8b7640 1 -- 172.21.15.106:0/1664812886 learned_addr learned my addr 172.21.15.106:0/1664812886 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17d0b8640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff178070750 0x7ff1780b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17d8b9640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff17809b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17c8b7640 1 -- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 msgr2=0x7ff17809b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17c8b7640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff17809b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17c8b7640 1 -- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff178070750 msgr2=0x7ff1780b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17c8b7640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff178070750 0x7ff1780b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17c8b7640 1 -- 172.21.15.106:0/1664812886 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff178147cd0 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17d8b9640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff17809b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17c8b7640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1780bbf70 0x7ff17809c9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00e840 tx=0x7ff16c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff175ffb640 1 -- 172.21.15.106:0/1664812886 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c017070 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff175ffb640 1 -- 172.21.15.106:0/1664812886 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff16c00c940 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17809dd60 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff175ffb640 1 -- 172.21.15.106:0/1664812886 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00cd10 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.337+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17809fdf0 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.338+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff178068a90 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.339+0000 7ff175ffb640 1 -- 172.21.15.106:0/1664812886 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff16c01a070 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.339+0000 7ff175ffb640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff16406c8f0 0x7ff16406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.339+0000 7ff17d0b8640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff16406c8f0 0x7ff16406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.339+0000 7ff175ffb640 1 -- 172.21.15.106:0/1664812886 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7ff16c08b8b0 con 0x7ff1780bbf70 2024-04-16T12:57:19.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.340+0000 7ff17d0b8640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff16406c8f0 0x7ff16406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff168035000 tx=0x7ff168008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.344+0000 7ff175ffb640 1 -- 172.21.15.106:0/1664812886 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff16c059720 con 0x7ff1780bbf70 2024-04-16T12:57:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.522+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff17809f830 con 0x7ff1780bbf70 2024-04-16T12:57:19.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.523+0000 7ff175ffb640 1 -- 172.21.15.106:0/1664812886 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7ff16c05da20 con 0x7ff1780bbf70 2024-04-16T12:57:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:19.525 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:18.241758+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff16406c8f0 msgr2=0x7ff16406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff16406c8f0 0x7ff16406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff168035000 tx=0x7ff168008030 comp rx=0 tx=0).stop 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1780bbf70 msgr2=0x7ff17809c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1780bbf70 0x7ff17809c9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00e840 tx=0x7ff16c00ed00 comp rx=0 tx=0).stop 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 shutdown_connections 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff16406c8f0 0x7ff16406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff178148260 0x7ff17809b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1780bbf70 0x7ff17809c9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 --2- 172.21.15.106:0/1664812886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff178070750 0x7ff1780b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 >> 172.21.15.106:0/1664812886 conn(0x7ff17809aa60 msgr2=0x7ff1780b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:19.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 shutdown_connections 2024-04-16T12:57:19.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.525+0000 7ff17f31c640 1 -- 172.21.15.106:0/1664812886 wait complete. 2024-04-16T12:57:19.538 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T12:57:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.643+0000 7f7668131640 1 Processor -- start 2024-04-16T12:57:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.643+0000 7f7668131640 1 -- start start 2024-04-16T12:57:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.643+0000 7f7668131640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76600b8000 0x7f7660148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.643+0000 7f7668131640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76600b5b80 con 0x7f76600b57a0 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f7668131640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7660147d50 con 0x7f76601421a0 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f7668131640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f76600b76c0 con 0x7f76600b8000 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f76666ce640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76600b8000 0x7f7660148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f76666ce640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76600b8000 0x7f7660148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58096/0 (socket says 172.21.15.106:58096) 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f76666ce640 1 -- 172.21.15.106:0/3517313628 learned_addr learned my addr 172.21.15.106:0/3517313628 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f7665ecd640 1 --1- 172.21.15.106:0/3517313628 >> v1:172.21.15.106:6789/0 conn(0x7f76600b57a0 0x7f7660141a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36358/0 (socket says 172.21.15.106:36358) 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f76666ce640 1 -- 172.21.15.106:0/3517313628 >> v1:172.21.15.171:6789/0 conn(0x7f76601421a0 legacy=0x7f76601506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f76666ce640 1 -- 172.21.15.106:0/3517313628 >> v1:172.21.15.106:6789/0 conn(0x7f76600b57a0 legacy=0x7f7660141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.644+0000 7f76666ce640 1 -- 172.21.15.106:0/3517313628 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76600b4f50 con 0x7f76600b8000 2024-04-16T12:57:19.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f76666ce640 1 --2- 172.21.15.106:0/3517313628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660148810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7658009870 tx=0x7f765802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc668a298e5a8ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7664ecb640 1 -- 172.21.15.106:0/3517313628 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765802e070 con 0x7f76600b8000 2024-04-16T12:57:19.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7664ecb640 1 -- 172.21.15.106:0/3517313628 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7658037070 con 0x7f76600b8000 2024-04-16T12:57:19.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7664ecb640 1 -- 172.21.15.106:0/3517313628 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658031a00 con 0x7f76600b8000 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7668131640 1 -- 172.21.15.106:0/3517313628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 msgr2=0x7f7660148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7668131640 1 --2- 172.21.15.106:0/3517313628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660148810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7658009870 tx=0x7f765802b880 comp rx=0 tx=0).stop 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7668131640 1 -- 172.21.15.106:0/3517313628 shutdown_connections 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7668131640 1 --2- 172.21.15.106:0/3517313628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660148810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7668131640 1 -- 172.21.15.106:0/3517313628 >> 172.21.15.106:0/3517313628 conn(0x7f76600bd680 msgr2=0x7f76600bda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7668131640 1 -- 172.21.15.106:0/3517313628 shutdown_connections 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.645+0000 7f7668131640 1 -- 172.21.15.106:0/3517313628 wait complete. 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.646+0000 7f7668131640 1 Processor -- start 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.646+0000 7f7668131640 1 -- start start 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f7668131640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76600b57a0 0x7f766014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f7668131640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f7668131640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76601421a0 0x7f7660142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f7668131640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f76601482f0 con 0x7f76600b8000 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f7668131640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7660148d50 con 0x7f76600b57a0 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f7668131640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76600be550 con 0x7f76601421a0 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58110/0 (socket says 172.21.15.106:58110) 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 -- 172.21.15.106:0/1791565520 learned_addr learned my addr 172.21.15.106:0/1791565520 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f7665ecd640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76600b57a0 0x7f766014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76666ce640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76601421a0 0x7f7660142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 -- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76601421a0 msgr2=0x7f7660142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76601421a0 0x7f7660142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 -- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76600b57a0 msgr2=0x7f766014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76600b57a0 0x7f766014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.647+0000 7f76656cc640 1 -- 172.21.15.106:0/1791565520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76601440a0 con 0x7f76600b8000 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.648+0000 7f76656cc640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660144e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f765000b3c0 tx=0x7f765000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.648+0000 7f76567fc640 1 -- 172.21.15.106:0/1791565520 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650011830 con 0x7f76600b8000 2024-04-16T12:57:19.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.648+0000 7f76567fc640 1 -- 172.21.15.106:0/1791565520 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7650016070 con 0x7f76600b8000 2024-04-16T12:57:19.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.648+0000 7f76567fc640 1 -- 172.21.15.106:0/1791565520 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650011c50 con 0x7f76600b8000 2024-04-16T12:57:19.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.648+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76601d1fc0 con 0x7f76600b8000 2024-04-16T12:57:19.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.648+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7660142b80 con 0x7f76600b8000 2024-04-16T12:57:19.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.649+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76601458b0 con 0x7f76600b8000 2024-04-16T12:57:19.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.649+0000 7f76567fc640 1 -- 172.21.15.106:0/1791565520 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f765001b460 con 0x7f76600b8000 2024-04-16T12:57:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.650+0000 7f76567fc640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f764406c920 0x7f764406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.650+0000 7f7665ecd640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f764406c920 0x7f764406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.650+0000 7f76567fc640 1 -- 172.21.15.106:0/1791565520 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f765008b560 con 0x7f76600b8000 2024-04-16T12:57:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.650+0000 7f7665ecd640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f764406c920 0x7f764406ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f765c0012e0 tx=0x7f765c005b70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:19.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.654+0000 7f76567fc640 1 -- 172.21.15.106:0/1791565520 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7650020020 con 0x7f76600b8000 2024-04-16T12:57:19.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.868+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7660145650 con 0x7f76600b8000 2024-04-16T12:57:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.888+0000 7f76567fc640 1 -- 172.21.15.106:0/1791565520 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f7650059a20 con 0x7f76600b8000 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f764406c920 msgr2=0x7f764406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f764406c920 0x7f764406ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f765c0012e0 tx=0x7f765c005b70 comp rx=0 tx=0).stop 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 msgr2=0x7f7660144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660144e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f765000b3c0 tx=0x7f765000b880 comp rx=0 tx=0).stop 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 shutdown_connections 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f764406c920 0x7f764406ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76601421a0 0x7f7660142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76600b8000 0x7f7660144e10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 --2- 172.21.15.106:0/1791565520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76600b57a0 0x7f766014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 >> 172.21.15.106:0/1791565520 conn(0x7f76600bd680 msgr2=0x7f7660141860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 shutdown_connections 2024-04-16T12:57:19.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:19.891+0000 7f7668131640 1 -- 172.21.15.106:0/1791565520 wait complete. 2024-04-16T12:57:19.905 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T12:57:19.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T12:57:20.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.010+0000 7fe824eb2640 1 Processor -- start 2024-04-16T12:57:20.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.010+0000 7fe824eb2640 1 -- start start 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.010+0000 7fe824eb2640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8200b57a0 0x7fe820148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.010+0000 7fe824eb2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8200b5b80 con 0x7fe8201421a0 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.010+0000 7fe824eb2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe820147d50 con 0x7fe8200b8000 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.010+0000 7fe824eb2640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe8200b76c0 con 0x7fe8200b57a0 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8200b57a0 0x7fe820148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81ed9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe8201421a0 0x7fe8201526d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36368/0 (socket says 172.21.15.106:36368) 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8200b57a0 0x7fe820148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58122/0 (socket says 172.21.15.106:58122) 2024-04-16T12:57:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81ed9d640 1 -- 172.21.15.106:0/3940730229 learned_addr learned my addr 172.21.15.106:0/3940730229 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81e59c640 1 -- 172.21.15.106:0/3940730229 >> v1:172.21.15.171:6789/0 conn(0x7fe8200b8000 legacy=0x7fe820141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81e59c640 1 -- 172.21.15.106:0/3940730229 >> v1:172.21.15.106:6789/0 conn(0x7fe8201421a0 legacy=0x7fe8201526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81e59c640 1 -- 172.21.15.106:0/3940730229 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8200b4f50 con 0x7fe8200b57a0 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.011+0000 7fe81d59a640 1 -- 172.21.15.106:0/3940730229 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518604963 0 0) 0x7fe8200b5b80 con 0x7fe8201421a0 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe81e59c640 1 --2- 172.21.15.106:0/3940730229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8200b57a0 0x7fe820148810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8100097a0 tx=0x7fe81002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951da280c4bb60ca server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe81d59a640 1 -- 172.21.15.106:0/3940730229 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810038070 con 0x7fe8200b57a0 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe81d59a640 1 -- 172.21.15.106:0/3940730229 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810031700 con 0x7fe8200b57a0 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe81d59a640 1 -- 172.21.15.106:0/3940730229 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810031ad0 con 0x7fe8200b57a0 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe824eb2640 1 -- 172.21.15.106:0/3940730229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8200b57a0 msgr2=0x7fe820148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe824eb2640 1 --2- 172.21.15.106:0/3940730229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8200b57a0 0x7fe820148810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8100097a0 tx=0x7fe81002b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe824eb2640 1 -- 172.21.15.106:0/3940730229 shutdown_connections 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe824eb2640 1 --2- 172.21.15.106:0/3940730229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8200b57a0 0x7fe820148810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe824eb2640 1 -- 172.21.15.106:0/3940730229 >> 172.21.15.106:0/3940730229 conn(0x7fe8200bd680 msgr2=0x7fe8200bda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe824eb2640 1 -- 172.21.15.106:0/3940730229 shutdown_connections 2024-04-16T12:57:20.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.012+0000 7fe824eb2640 1 -- 172.21.15.106:0/3940730229 wait complete. 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 Processor -- start 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 -- start start 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8200b57a0 0x7fe82014b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8200b8000 0x7fe8201dda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8201421a0 0x7fe8201ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201482f0 con 0x7fe8201421a0 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe820148d50 con 0x7fe8200b8000 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe824eb2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe8200be550 con 0x7fe8200b57a0 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe81ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8201421a0 0x7fe8201ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe81ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8201421a0 0x7fe8201ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58132/0 (socket says 172.21.15.106:58132) 2024-04-16T12:57:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe81ed9d640 1 -- 172.21.15.106:0/2315019200 learned_addr learned my addr 172.21.15.106:0/2315019200 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe81e59c640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8200b57a0 0x7fe82014b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.014+0000 7fe81dd9b640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8200b8000 0x7fe8201dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81ed9d640 1 -- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8200b57a0 msgr2=0x7fe82014b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81ed9d640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8200b57a0 0x7fe82014b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81ed9d640 1 -- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8200b8000 msgr2=0x7fe8201dda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81ed9d640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8200b8000 0x7fe8201dda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81ed9d640 1 -- 172.21.15.106:0/2315019200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201d1850 con 0x7fe8201421a0 2024-04-16T12:57:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81e59c640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8200b57a0 0x7fe82014b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81dd9b640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8200b8000 0x7fe8201dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe81ed9d640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8201421a0 0x7fe8201ddf90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c780 tx=0x7fe81800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe80effd640 1 -- 172.21.15.106:0/2315019200 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818018070 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe80effd640 1 -- 172.21.15.106:0/2315019200 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81800ce30 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8201dd550 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe80effd640 1 -- 172.21.15.106:0/2315019200 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81800a840 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.015+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe820145210 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.016+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8201dd720 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.016+0000 7fe80effd640 1 -- 172.21.15.106:0/2315019200 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe81801b070 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.017+0000 7fe80effd640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe80006c8f0 0x7fe80006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.017+0000 7fe80effd640 1 -- 172.21.15.106:0/2315019200 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe81808b020 con 0x7fe8201421a0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.017+0000 7fe81e59c640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe80006c8f0 0x7fe80006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.017+0000 7fe81e59c640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe80006c8f0 0x7fe80006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe810035000 tx=0x7fe810008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:20.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.021+0000 7fe80effd640 1 -- 172.21.15.106:0/2315019200 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe8180594e0 con 0x7fe8201421a0 2024-04-16T12:57:20.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.234+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe8201d1ac0 con 0x7fe8201421a0 2024-04-16T12:57:20.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.897+0000 7fe80effd640 1 -- 172.21.15.106:0/2315019200 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fe818058de0 con 0x7fe8201421a0 2024-04-16T12:57:20.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe80006c8f0 msgr2=0x7fe80006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:20.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe80006c8f0 0x7fe80006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe810035000 tx=0x7fe810008030 comp rx=0 tx=0).stop 2024-04-16T12:57:20.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8201421a0 msgr2=0x7fe8201ddf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:20.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8201421a0 0x7fe8201ddf90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c780 tx=0x7fe81800cc40 comp rx=0 tx=0).stop 2024-04-16T12:57:20.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 shutdown_connections 2024-04-16T12:57:20.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe80006c8f0 0x7fe80006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8201421a0 0x7fe8201ddf90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8200b8000 0x7fe8201dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 --2- 172.21.15.106:0/2315019200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8200b57a0 0x7fe82014b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:20.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 >> 172.21.15.106:0/2315019200 conn(0x7fe8200bd680 msgr2=0x7fe8200b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:20.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 shutdown_connections 2024-04-16T12:57:20.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:20.899+0000 7fe824eb2640 1 -- 172.21.15.106:0/2315019200 wait complete. 2024-04-16T12:57:20.914 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T12:57:20.914 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:21.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.019+0000 7f4675740640 1 Processor -- start 2024-04-16T12:57:21.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.019+0000 7f4675740640 1 -- start start 2024-04-16T12:57:21.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f4675740640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4670142340 0x7f46700b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f4675740640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700b5670 con 0x7f46700b4c90 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f4675740640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467014b550 con 0x7f46700b6760 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f4675740640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f46700b5910 con 0x7f4670142340 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4670142340 0x7f46700b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4670142340 0x7f46700b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58136/0 (socket says 172.21.15.106:58136) 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466effd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f46700b4c90 0x7f467014bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36382/0 (socket says 172.21.15.106:36382) 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466f7fe640 1 -- 172.21.15.106:0/1295150062 learned_addr learned my addr 172.21.15.106:0/1295150062 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466f7fe640 1 -- 172.21.15.106:0/1295150062 >> v1:172.21.15.171:6789/0 conn(0x7f46700b6760 legacy=0x7f4670141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466f7fe640 1 -- 172.21.15.106:0/1295150062 >> v1:172.21.15.106:6789/0 conn(0x7f46700b4c90 legacy=0x7f467014bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466e7fc640 1 -- 172.21.15.106:0/1295150062 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120603349 0 0) 0x7f46700b5670 con 0x7f46700b4c90 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.020+0000 7f466f7fe640 1 -- 172.21.15.106:0/1295150062 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467014b830 con 0x7f4670142340 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.021+0000 7f466f7fe640 1 --2- 172.21.15.106:0/1295150062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4670142340 0x7f46700b5070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e50 tx=0x7f466802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2437e64e930366a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.021+0000 7f466e7fc640 1 -- 172.21.15.106:0/1295150062 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466802c9f0 con 0x7f4670142340 2024-04-16T12:57:21.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.021+0000 7f466e7fc640 1 -- 172.21.15.106:0/1295150062 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466802cb90 con 0x7f4670142340 2024-04-16T12:57:21.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.021+0000 7f466e7fc640 1 -- 172.21.15.106:0/1295150062 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46680343f0 con 0x7f4670142340 2024-04-16T12:57:21.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.022+0000 7f4675740640 1 -- 172.21.15.106:0/1295150062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4670142340 msgr2=0x7f46700b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.022+0000 7f4675740640 1 --2- 172.21.15.106:0/1295150062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4670142340 0x7f46700b5070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e50 tx=0x7f466802be50 comp rx=0 tx=0).stop 2024-04-16T12:57:21.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.022+0000 7f4675740640 1 -- 172.21.15.106:0/1295150062 shutdown_connections 2024-04-16T12:57:21.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.022+0000 7f4675740640 1 --2- 172.21.15.106:0/1295150062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4670142340 0x7f46700b5070 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.022+0000 7f4675740640 1 -- 172.21.15.106:0/1295150062 >> 172.21.15.106:0/1295150062 conn(0x7f4670067f20 msgr2=0x7f46700bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:21.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.022+0000 7f4675740640 1 -- 172.21.15.106:0/1295150062 shutdown_connections 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.022+0000 7f4675740640 1 -- 172.21.15.106:0/1295150062 wait complete. 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 Processor -- start 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 -- start start 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46700b4c90 0x7f46701ddc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4670142340 0x7f467014a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f467013c390 0x7f4670137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f46700b76d0 con 0x7f467013c390 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f46701537c0 con 0x7f4670142340 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.023+0000 7f4675740640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4670153940 con 0x7f46700b4c90 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f467013c390 0x7f4670137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f467013c390 0x7f4670137450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58150/0 (socket says 172.21.15.106:58150) 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 -- 172.21.15.106:0/3434234388 learned_addr learned my addr 172.21.15.106:0/3434234388 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f46667fc640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4670142340 0x7f467014a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466effd640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46700b4c90 0x7f46701ddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 -- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46700b4c90 msgr2=0x7f46701ddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46700b4c90 0x7f46701ddc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 -- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4670142340 msgr2=0x7f467014a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4670142340 0x7f467014a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 -- 172.21.15.106:0/3434234388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467013d2d0 con 0x7f467013c390 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f46667fc640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4670142340 0x7f467014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f466f7fe640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f467013c390 0x7f4670137450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e50 tx=0x7f4668004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f4667fff640 1 -- 172.21.15.106:0/3434234388 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668044020 con 0x7f467013c390 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f4667fff640 1 -- 172.21.15.106:0/3434234388 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4668040470 con 0x7f467013c390 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f4667fff640 1 -- 172.21.15.106:0/3434234388 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668040860 con 0x7f467013c390 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467013d5b0 con 0x7f467013c390 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.024+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467013da70 con 0x7f467013c390 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.025+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4670075540 con 0x7f467013c390 2024-04-16T12:57:21.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.026+0000 7f4667fff640 1 -- 172.21.15.106:0/3434234388 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4668047020 con 0x7f467013c390 2024-04-16T12:57:21.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.026+0000 7f4667fff640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f465006c8f0 0x7f465006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.026+0000 7f4667fff640 1 -- 172.21.15.106:0/3434234388 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f46680ae990 con 0x7f467013c390 2024-04-16T12:57:21.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.026+0000 7f466effd640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f465006c8f0 0x7f465006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.027+0000 7f466effd640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f465006c8f0 0x7f465006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4660000f60 tx=0x7f4660007b70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.030+0000 7f4667fff640 1 -- 172.21.15.106:0/3434234388 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4670075540 con 0x7f467013c390 2024-04-16T12:57:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.243+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f467006c3f0 con 0x7f467013c390 2024-04-16T12:57:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.243+0000 7f4667fff640 1 -- 172.21.15.106:0/3434234388 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f467006c3f0 con 0x7f467013c390 2024-04-16T12:57:21.245 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:21.246 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f465006c8f0 msgr2=0x7f465006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f465006c8f0 0x7f465006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4660000f60 tx=0x7f4660007b70 comp rx=0 tx=0).stop 2024-04-16T12:57:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f467013c390 msgr2=0x7f4670137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f467013c390 0x7f4670137450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e50 tx=0x7f4668004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 shutdown_connections 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f465006c8f0 0x7f465006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f467013c390 0x7f4670137450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4670142340 0x7f467014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 --2- 172.21.15.106:0/3434234388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46700b4c90 0x7f46701ddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.245+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 >> 172.21.15.106:0/3434234388 conn(0x7f4670067f20 msgr2=0x7f4670141a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.246+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 shutdown_connections 2024-04-16T12:57:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.246+0000 7f4675740640 1 -- 172.21.15.106:0/3434234388 wait complete. 2024-04-16T12:57:21.259 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.359+0000 7ff7c3340640 1 Processor -- start 2024-04-16T12:57:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c3340640 1 -- start start 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c3340640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff7bc071cf0 0x7ff7bc14b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c3340640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7bc073af0 0x7ff7bc0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c3340640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc141ad0 0x7ff7bc141f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c3340640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff7bc073280 con 0x7ff7bc073af0 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c3340640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff7bc0bb240 con 0x7ff7bc071cf0 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c3340640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff7bc0720d0 con 0x7ff7bc141ad0 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c08db640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7bc073af0 0x7ff7bc0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c08db640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7bc073af0 0x7ff7bc0b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58154/0 (socket says 172.21.15.106:58154) 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.360+0000 7ff7c08db640 1 -- 172.21.15.106:0/2869666148 learned_addr learned my addr 172.21.15.106:0/2869666148 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c10dc640 1 --2- 172.21.15.106:0/2869666148 >> v2:172.21.15.171:3300/0 conn(0x7ff7bc071cf0 0x7ff7bc14b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c18dd640 1 --2- 172.21.15.106:0/2869666148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc141ad0 0x7ff7bc141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c08db640 1 -- 172.21.15.106:0/2869666148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc141ad0 msgr2=0x7ff7bc141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c08db640 1 --2- 172.21.15.106:0/2869666148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc141ad0 0x7ff7bc141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c08db640 1 -- 172.21.15.106:0/2869666148 >> v2:172.21.15.171:3300/0 conn(0x7ff7bc071cf0 msgr2=0x7ff7bc14b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c08db640 1 --2- 172.21.15.106:0/2869666148 >> v2:172.21.15.171:3300/0 conn(0x7ff7bc071cf0 0x7ff7bc14b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c08db640 1 -- 172.21.15.106:0/2869666148 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7bc0bac80 con 0x7ff7bc073af0 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7c08db640 1 --2- 172.21.15.106:0/2869666148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc073af0 0x7ff7bc0b0fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0b4e10 tx=0x7ff7b002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b78a0132af0e0d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7bbfff640 1 -- 172.21.15.106:0/2869666148 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b002c950 con 0x7ff7bc073af0 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7bbfff640 1 -- 172.21.15.106:0/2869666148 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b002caf0 con 0x7ff7bc073af0 2024-04-16T12:57:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.361+0000 7ff7bbfff640 1 -- 172.21.15.106:0/2869666148 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00343f0 con 0x7ff7bc073af0 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 -- 172.21.15.106:0/2869666148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc073af0 msgr2=0x7ff7bc0b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 --2- 172.21.15.106:0/2869666148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc073af0 0x7ff7bc0b0fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0b4e10 tx=0x7ff7b002bdb0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 -- 172.21.15.106:0/2869666148 shutdown_connections 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 --2- 172.21.15.106:0/2869666148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc141ad0 0x7ff7bc141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 --2- 172.21.15.106:0/2869666148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc073af0 0x7ff7bc0b0fc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 --2- 172.21.15.106:0/2869666148 >> v2:172.21.15.171:3300/0 conn(0x7ff7bc071cf0 0x7ff7bc14b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 -- 172.21.15.106:0/2869666148 >> 172.21.15.106:0/2869666148 conn(0x7ff7bc06d150 msgr2=0x7ff7bc0ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 -- 172.21.15.106:0/2869666148 shutdown_connections 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.362+0000 7ff7c3340640 1 -- 172.21.15.106:0/2869666148 wait complete. 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.363+0000 7ff7c3340640 1 Processor -- start 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.363+0000 7ff7c3340640 1 -- start start 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c3340640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc071cf0 0x7ff7bc1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c3340640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc073af0 0x7ff7bc14a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c3340640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7bc141ad0 0x7ff7bc1de190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c3340640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc0b1500 con 0x7ff7bc071cf0 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c3340640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc142460 con 0x7ff7bc141ad0 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c3340640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff7bc06b9b0 con 0x7ff7bc073af0 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc071cf0 0x7ff7bc1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc071cf0 0x7ff7bc1437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58168/0 (socket says 172.21.15.106:58168) 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 -- 172.21.15.106:0/3516523291 learned_addr learned my addr 172.21.15.106:0/3516523291 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c18dd640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7bc141ad0 0x7ff7bc1de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c08db640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc073af0 0x7ff7bc14a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 -- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc073af0 msgr2=0x7ff7bc14a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc073af0 0x7ff7bc14a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 -- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7bc141ad0 msgr2=0x7ff7bc1de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7bc141ad0 0x7ff7bc1de190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 -- 172.21.15.106:0/3516523291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7bc143e70 con 0x7ff7bc071cf0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c10dc640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc071cf0 0x7ff7bc1437e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c820 tx=0x7ff7ac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7b9ffb640 1 -- 172.21.15.106:0/3516523291 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac015070 con 0x7ff7bc071cf0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7b9ffb640 1 -- 172.21.15.106:0/3516523291 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ac004240 con 0x7ff7bc071cf0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7bc142b40 con 0x7ff7bc071cf0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.364+0000 7ff7b9ffb640 1 -- 172.21.15.106:0/3516523291 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00ce10 con 0x7ff7bc071cf0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.365+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7bc149210 con 0x7ff7bc071cf0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.365+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7bc0691a0 con 0x7ff7bc071cf0 2024-04-16T12:57:21.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.366+0000 7ff7b9ffb640 1 -- 172.21.15.106:0/3516523291 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7ac007830 con 0x7ff7bc071cf0 2024-04-16T12:57:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.366+0000 7ff7b9ffb640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff7a806c8f0 0x7ff7a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.366+0000 7ff7b9ffb640 1 -- 172.21.15.106:0/3516523291 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff7ac08b930 con 0x7ff7bc071cf0 2024-04-16T12:57:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.366+0000 7ff7c08db640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff7a806c8f0 0x7ff7a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.367+0000 7ff7c08db640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff7a806c8f0 0x7ff7a806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0035000 tx=0x7ff7b0030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.371+0000 7ff7b9ffb640 1 -- 172.21.15.106:0/3516523291 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7ac0597a0 con 0x7ff7bc071cf0 2024-04-16T12:57:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.546+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7bc072c80 con 0x7ff7bc071cf0 2024-04-16T12:57:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.547+0000 7ff7b9ffb640 1 -- 172.21.15.106:0/3516523291 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7ff7ac05daa0 con 0x7ff7bc071cf0 2024-04-16T12:57:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:21.551 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff7a806c8f0 msgr2=0x7ff7a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff7a806c8f0 0x7ff7a806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0035000 tx=0x7ff7b0030000 comp rx=0 tx=0).stop 2024-04-16T12:57:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc071cf0 msgr2=0x7ff7bc1437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc071cf0 0x7ff7bc1437e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c820 tx=0x7ff7ac00cce0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 shutdown_connections 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff7a806c8f0 0x7ff7a806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7bc141ad0 0x7ff7bc1de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7bc073af0 0x7ff7bc14a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 --2- 172.21.15.106:0/3516523291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7bc071cf0 0x7ff7bc1437e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.549+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 >> 172.21.15.106:0/3516523291 conn(0x7ff7bc06d150 msgr2=0x7ff7bc06bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.550+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 shutdown_connections 2024-04-16T12:57:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.550+0000 7ff7c3340640 1 -- 172.21.15.106:0/3516523291 wait complete. 2024-04-16T12:57:21.563 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T12:57:21.563 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:57:21.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.663+0000 7fdafafa8640 1 Processor -- start 2024-04-16T12:57:21.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.663+0000 7fdafafa8640 1 -- start start 2024-04-16T12:57:21.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.663+0000 7fdafafa8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf4144db0 0x7fdaf40b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.663+0000 7fdafafa8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf40b3fc0 con 0x7fdaf40afee0 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.663+0000 7fdafafa8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf40b9720 con 0x7fdaf40b4a50 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.663+0000 7fdafafa8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf40b9a00 con 0x7fdaf4144db0 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaebfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdaf40afee0 0x7fdaf41446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36390/0 (socket says 172.21.15.106:36390) 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaebfff640 1 -- 172.21.15.106:0/1968905904 learned_addr learned my addr 172.21.15.106:0/1968905904 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaf9545640 1 --2- 172.21.15.106:0/1968905904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf4144db0 0x7fdaf40b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaeb7fe640 1 -- 172.21.15.106:0/1968905904 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281730301 0 0) 0x7fdaf40b3fc0 con 0x7fdaf40afee0 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaeb7fe640 1 -- 172.21.15.106:0/1968905904 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdadc003520 con 0x7fdaf40afee0 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaf9545640 1 -- 172.21.15.106:0/1968905904 >> v1:172.21.15.171:6789/0 conn(0x7fdaf40b4a50 legacy=0x7fdaf409d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaeb7fe640 1 -- 172.21.15.106:0/1968905904 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2906580051 0 0) 0x7fdadc003520 con 0x7fdaf40afee0 2024-04-16T12:57:21.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaf9545640 1 -- 172.21.15.106:0/1968905904 >> v1:172.21.15.106:6789/0 conn(0x7fdaf40afee0 legacy=0x7fdaf41446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.664+0000 7fdaf9545640 1 -- 172.21.15.106:0/1968905904 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf40b4e30 con 0x7fdaf4144db0 2024-04-16T12:57:21.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.665+0000 7fdaf9545640 1 --2- 172.21.15.106:0/1968905904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf4144db0 0x7fdaf40b0340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00aed0 tx=0x7fdaec02cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f895b68ff7b646bf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.665+0000 7fdaeb7fe640 1 -- 172.21.15.106:0/1968905904 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4001670 con 0x7fdaf4144db0 2024-04-16T12:57:21.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.665+0000 7fdaeb7fe640 1 -- 172.21.15.106:0/1968905904 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaec02d550 con 0x7fdaf4144db0 2024-04-16T12:57:21.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.665+0000 7fdaeb7fe640 1 -- 172.21.15.106:0/1968905904 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec02d900 con 0x7fdaf4144db0 2024-04-16T12:57:21.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.666+0000 7fdafafa8640 1 -- 172.21.15.106:0/1968905904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf4144db0 msgr2=0x7fdaf40b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.666+0000 7fdafafa8640 1 --2- 172.21.15.106:0/1968905904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf4144db0 0x7fdaf40b0340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00aed0 tx=0x7fdaec02cc30 comp rx=0 tx=0).stop 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.666+0000 7fdafafa8640 1 -- 172.21.15.106:0/1968905904 shutdown_connections 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.666+0000 7fdafafa8640 1 --2- 172.21.15.106:0/1968905904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf4144db0 0x7fdaf40b0340 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.666+0000 7fdafafa8640 1 -- 172.21.15.106:0/1968905904 >> 172.21.15.106:0/1968905904 conn(0x7fdaf409cc10 msgr2=0x7fdaf406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.666+0000 7fdafafa8640 1 -- 172.21.15.106:0/1968905904 shutdown_connections 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.666+0000 7fdafafa8640 1 -- 172.21.15.106:0/1968905904 wait complete. 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 Processor -- start 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 -- start start 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf40afee0 0x7fdaf4143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf40b4a50 0x7fdaf413f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaf4144db0 0x7fdaf41dec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf406da10 con 0x7fdaf4144db0 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf406d890 con 0x7fdaf40b4a50 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.667+0000 7fdafafa8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf406db90 con 0x7fdaf40afee0 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaf4144db0 0x7fdaf41dec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaf4144db0 0x7fdaf41dec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58180/0 (socket says 172.21.15.106:58180) 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 -- 172.21.15.106:0/971548490 learned_addr learned my addr 172.21.15.106:0/971548490 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf8d44640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf40afee0 0x7fdaf4143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaebfff640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf40b4a50 0x7fdaf413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 -- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf40afee0 msgr2=0x7fdaf4143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf40afee0 0x7fdaf4143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 -- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf40b4a50 msgr2=0x7fdaf413f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf40b4a50 0x7fdaf413f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 -- 172.21.15.106:0/971548490 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf413feb0 con 0x7fdaf4144db0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdaf9545640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaf4144db0 0x7fdaf41dec70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdaec037040 tx=0x7fdaec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdae97fa640 1 -- 172.21.15.106:0/971548490 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec043020 con 0x7fdaf4144db0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdae97fa640 1 -- 172.21.15.106:0/971548490 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaec02de30 con 0x7fdaf4144db0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdae97fa640 1 -- 172.21.15.106:0/971548490 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00a560 con 0x7fdaf4144db0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.668+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf4146120 con 0x7fdaf4144db0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.669+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf4073360 con 0x7fdaf4144db0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.670+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf4068a90 con 0x7fdaf4144db0 2024-04-16T12:57:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.670+0000 7fdae97fa640 1 -- 172.21.15.106:0/971548490 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdaec046020 con 0x7fdaf4144db0 2024-04-16T12:57:21.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.671+0000 7fdae97fa640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdae006c920 0x7fdae006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:21.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.671+0000 7fdaf8d44640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdae006c920 0x7fdae006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:21.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.671+0000 7fdae97fa640 1 -- 172.21.15.106:0/971548490 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdaec0ada00 con 0x7fdaf4144db0 2024-04-16T12:57:21.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.671+0000 7fdaf8d44640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdae006c920 0x7fdae006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000f60 tx=0x7fdaf0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:21.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.675+0000 7fdae97fa640 1 -- 172.21.15.106:0/971548490 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdaec04d030 con 0x7fdaf4144db0 2024-04-16T12:57:21.769 INFO:tasks.ceph.mds.a.smithi106.stderr:2024-04-16T12:57:21.766+0000 7f666e1df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T12:57:21.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.846+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdaf40b8f70 con 0x7fdae006c920 2024-04-16T12:57:21.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.852+0000 7fdae97fa640 1 -- 172.21.15.106:0/971548490 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7fdaf40b8f70 con 0x7fdae006c920 2024-04-16T12:57:21.857 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:57:21.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdae006c920 msgr2=0x7fdae006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdae006c920 0x7fdae006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000f60 tx=0x7fdaf0009040 comp rx=0 tx=0).stop 2024-04-16T12:57:21.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaf4144db0 msgr2=0x7fdaf41dec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaf4144db0 0x7fdaf41dec70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdaec037040 tx=0x7fdaec004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 shutdown_connections 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdae006c920 0x7fdae006ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaf4144db0 0x7fdaf41dec70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf40b4a50 0x7fdaf413f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 --2- 172.21.15.106:0/971548490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf40afee0 0x7fdaf4143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 >> 172.21.15.106:0/971548490 conn(0x7fdaf409cc10 msgr2=0x7fdaf4141940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 shutdown_connections 2024-04-16T12:57:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:21.855+0000 7fdafafa8640 1 -- 172.21.15.106:0/971548490 wait complete. 2024-04-16T12:57:21.868 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-16T12:57:20.166102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218564,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756156,"statfs":{"total":773094113280,"available":772870303744,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000578"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-16T12:57:08.289007+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:08.289007+0000","last_peered":"2024-04-16T12:57:08.289007+0000","last_clean":"2024-04-16T12:57:08.289007+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:08.289007+0000","last_undegraded":"2024-04-16T12:57:08.289007+0000","last_fullsized":"2024-04-16T12:57:08.289007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:17.875587+0000","last_change":"2024-04-16T12:57:17.875587+0000","last_active":"2024-04-16T12:57:17.875587+0000","last_peered":"2024-04-16T12:57:17.875587+0000","last_clean":"2024-04-16T12:57:17.875587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:17.875587+0000","last_undegraded":"2024-04-16T12:57:17.875587+0000","last_fullsized":"2024-04-16T12:57:17.875587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:16.870564+0000","last_change":"2024-04-16T12:57:16.870564+0000","last_active":"2024-04-16T12:57:16.870564+0000","last_peered":"2024-04-16T12:57:16.870564+0000","last_clean":"2024-04-16T12:57:16.870564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:16.870564+0000","last_undegraded":"2024-04-16T12:57:16.870564+0000","last_fullsized":"2024-04-16T12:57:16.870564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:57:21.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:57:22.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.008+0000 7f3038550640 1 Processor -- start 2024-04-16T12:57:22.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.008+0000 7f3038550640 1 -- start start 2024-04-16T12:57:22.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.008+0000 7f3038550640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 0x7f3030148720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f3038550640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30300b6820 con 0x7f303014bd40 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f3038550640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303014c270 con 0x7f303014b8c0 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f3038550640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f30300b75c0 con 0x7f30300b6440 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f3036aed640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f303014bd40 0x7f3030152790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36394/0 (socket says 172.21.15.106:36394) 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f3036aed640 1 -- 172.21.15.106:0/2803720871 learned_addr learned my addr 172.21.15.106:0/2803720871 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228559131 0 0) 0x7f30300b6820 con 0x7f303014bd40 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30362ec640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 0x7f3030148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f301c003520 con 0x7f303014bd40 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1854617532 0 0) 0x7f301c003520 con 0x7f303014bd40 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 msgr2=0x7f3030148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 0x7f3030148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 >> v1:172.21.15.171:6789/0 conn(0x7f303014b8c0 legacy=0x7f3030141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3030147f20 con 0x7f303014bd40 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f30280019f0 con 0x7f303014bd40 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30362ec640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 0x7f3030148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 >> v1:172.21.15.106:6789/0 conn(0x7f303014bd40 legacy=0x7f3030152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301c0039e0 0x7f301c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f301c004800 0x7f301c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 0x7f301c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f301c0054b0 con 0x7f301c0039e0 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f301c005660 con 0x7f301c004800 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f301c00bf00 con 0x7f30300b6440 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f30362ec640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301c0039e0 0x7f301c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f3036aed640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 0x7f301c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.009+0000 7f3035aeb640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f301c004800 0x7f301c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30362ec640 1 -- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 msgr2=0x7f301c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30362ec640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30300b6440 0x7f301c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30362ec640 1 -- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f301c004800 msgr2=0x7f301c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30362ec640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f301c004800 0x7f301c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30362ec640 1 -- 172.21.15.106:0/2803720871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c003520 con 0x7f301c0039e0 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f3035aeb640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f301c004800 0x7f301c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30362ec640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301c0039e0 0x7f301c003e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30200098a0 tx=0x7f301c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c3f1249b0b10a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302000f040 con 0x7f301c0039e0 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3020004230 con 0x7f301c0039e0 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.010+0000 7f30352ea640 1 -- 172.21.15.106:0/2803720871 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3020003610 con 0x7f301c0039e0 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.011+0000 7f3038550640 1 -- 172.21.15.106:0/2803720871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301c0039e0 msgr2=0x7f301c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.011+0000 7f3038550640 1 --2- 172.21.15.106:0/2803720871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301c0039e0 0x7f301c003e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30200098a0 tx=0x7f301c005830 comp rx=0 tx=0).stop 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.011+0000 7f3036aed640 1 -- 172.21.15.106:0/2803720871 reap_dead start 2024-04-16T12:57:22.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.011+0000 7f3038550640 1 -- 172.21.15.106:0/2803720871 shutdown_connections 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.011+0000 7f3038550640 1 -- 172.21.15.106:0/2803720871 >> 172.21.15.106:0/2803720871 conn(0x7f30300bd630 msgr2=0x7f30300bda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.011+0000 7f3038550640 1 -- 172.21.15.106:0/2803720871 shutdown_connections 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.011+0000 7f3038550640 1 -- 172.21.15.106:0/2803720871 wait complete. 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.012+0000 7f3038550640 1 Processor -- start 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.012+0000 7f3038550640 1 -- start start 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f301c0039e0 0x7f303014aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30301d1ee0 0x7f30301d2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30301e0a60 0x7f30301e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f30300b7fb0 con 0x7f30301d1ee0 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30300b77f0 con 0x7f30301e0a60 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3030142020 con 0x7f301c0039e0 2024-04-16T12:57:22.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30301d1ee0 0x7f30301d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30301d1ee0 0x7f30301d2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58192/0 (socket says 172.21.15.106:58192) 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 -- 172.21.15.106:0/3362279825 learned_addr learned my addr 172.21.15.106:0/3362279825 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f30362ec640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f301c0039e0 0x7f303014aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3036aed640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30301e0a60 0x7f30301e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 -- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f301c0039e0 msgr2=0x7f303014aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f301c0039e0 0x7f303014aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 -- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30301e0a60 msgr2=0x7f30301e0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30301e0a60 0x7f30301e0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 -- 172.21.15.106:0/3362279825 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30301e0650 con 0x7f30301d1ee0 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3035aeb640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30301d1ee0 0x7f30301d2360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f302c00e630 tx=0x7f302c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3026ffd640 1 -- 172.21.15.106:0/3362279825 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0052e0 con 0x7f30301d1ee0 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3026ffd640 1 -- 172.21.15.106:0/3362279825 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c018070 con 0x7f30301d1ee0 2024-04-16T12:57:22.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30301d3ee0 con 0x7f30301d1ee0 2024-04-16T12:57:22.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3026ffd640 1 -- 172.21.15.106:0/3362279825 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c003810 con 0x7f30301d1ee0 2024-04-16T12:57:22.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.013+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30301d16c0 con 0x7f30301d1ee0 2024-04-16T12:57:22.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.014+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3030068a90 con 0x7f30301d1ee0 2024-04-16T12:57:22.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.015+0000 7f3026ffd640 1 -- 172.21.15.106:0/3362279825 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f302c0039b0 con 0x7f30301d1ee0 2024-04-16T12:57:22.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.015+0000 7f3026ffd640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.015+0000 7f30362ec640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.015+0000 7f3026ffd640 1 -- 172.21.15.106:0/3362279825 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f302c08b740 con 0x7f30301d1ee0 2024-04-16T12:57:22.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.016+0000 7f30362ec640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f301406c8f0 0x7f301406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3020035000 tx=0x7f3020031000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.020+0000 7f3026ffd640 1 -- 172.21.15.106:0/3362279825 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30301e0650 con 0x7f30301d1ee0 2024-04-16T12:57:22.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.192+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30300b7230 con 0x7f301406c8f0 2024-04-16T12:57:22.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.198+0000 7f3026ffd640 1 -- 172.21.15.106:0/3362279825 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f30300b7230 con 0x7f301406c8f0 2024-04-16T12:57:22.203 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:22.205 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:57:22.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f301406c8f0 msgr2=0x7f301406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f301406c8f0 0x7f301406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3020035000 tx=0x7f3020031000 comp rx=0 tx=0).stop 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30301d1ee0 msgr2=0x7f30301d2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30301d1ee0 0x7f30301d2360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f302c00e630 tx=0x7f302c00eaf0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 shutdown_connections 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30301e0a60 0x7f30301e0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30301d1ee0 0x7f30301d2360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 --2- 172.21.15.106:0/3362279825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f301c0039e0 0x7f303014aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 >> 172.21.15.106:0/3362279825 conn(0x7f30300bd630 msgr2=0x7f3030140e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 shutdown_connections 2024-04-16T12:57:22.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.201+0000 7f3038550640 1 -- 172.21.15.106:0/3362279825 wait complete. 2024-04-16T12:57:22.214 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-16T12:57:22.166391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.290950"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897555+0000","last_change":"2024-04-16T12:57:18.894988+0000","last_active":"2024-04-16T12:57:19.897555+0000","last_peered":"2024-04-16T12:57:19.897555+0000","last_clean":"2024-04-16T12:57:19.897555+0000","last_became_active":"2024-04-16T12:57:18.894707+0000","last_became_peered":"2024-04-16T12:57:18.894707+0000","last_unstale":"2024-04-16T12:57:19.897555+0000","last_undegraded":"2024-04-16T12:57:19.897555+0000","last_fullsized":"2024-04-16T12:57:19.897555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:19.298247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895563+0000","last_change":"2024-04-16T12:57:18.906652+0000","last_active":"2024-04-16T12:57:19.895563+0000","last_peered":"2024-04-16T12:57:19.895563+0000","last_clean":"2024-04-16T12:57:19.895563+0000","last_became_active":"2024-04-16T12:57:18.906392+0000","last_became_peered":"2024-04-16T12:57:18.906392+0000","last_unstale":"2024-04-16T12:57:19.895563+0000","last_undegraded":"2024-04-16T12:57:19.895563+0000","last_fullsized":"2024-04-16T12:57:19.895563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997603+0000","last_change":"2024-04-16T12:57:18.900639+0000","last_active":"2024-04-16T12:57:19.997603+0000","last_peered":"2024-04-16T12:57:19.997603+0000","last_clean":"2024-04-16T12:57:19.997603+0000","last_became_active":"2024-04-16T12:57:18.900378+0000","last_became_peered":"2024-04-16T12:57:18.900378+0000","last_unstale":"2024-04-16T12:57:19.997603+0000","last_undegraded":"2024-04-16T12:57:19.997603+0000","last_fullsized":"2024-04-16T12:57:19.997603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896269+0000","last_change":"2024-04-16T12:57:18.907839+0000","last_active":"2024-04-16T12:57:19.896269+0000","last_peered":"2024-04-16T12:57:19.896269+0000","last_clean":"2024-04-16T12:57:19.896269+0000","last_became_active":"2024-04-16T12:57:18.907578+0000","last_became_peered":"2024-04-16T12:57:18.907578+0000","last_unstale":"2024-04-16T12:57:19.896269+0000","last_undegraded":"2024-04-16T12:57:19.896269+0000","last_fullsized":"2024-04-16T12:57:19.896269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896746+0000","last_change":"2024-04-16T12:57:18.893375+0000","last_active":"2024-04-16T12:57:19.896746+0000","last_peered":"2024-04-16T12:57:19.896746+0000","last_clean":"2024-04-16T12:57:19.896746+0000","last_became_active":"2024-04-16T12:57:18.893078+0000","last_became_peered":"2024-04-16T12:57:18.893078+0000","last_unstale":"2024-04-16T12:57:19.896746+0000","last_undegraded":"2024-04-16T12:57:19.896746+0000","last_fullsized":"2024-04-16T12:57:19.896746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896621+0000","last_change":"2024-04-16T12:57:18.896791+0000","last_active":"2024-04-16T12:57:19.896621+0000","last_peered":"2024-04-16T12:57:19.896621+0000","last_clean":"2024-04-16T12:57:19.896621+0000","last_became_active":"2024-04-16T12:57:18.896523+0000","last_became_peered":"2024-04-16T12:57:18.896523+0000","last_unstale":"2024-04-16T12:57:19.896621+0000","last_undegraded":"2024-04-16T12:57:19.896621+0000","last_fullsized":"2024-04-16T12:57:19.896621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:19.298247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895721+0000","last_change":"2024-04-16T12:57:18.897907+0000","last_active":"2024-04-16T12:57:19.895721+0000","last_peered":"2024-04-16T12:57:19.895721+0000","last_clean":"2024-04-16T12:57:19.895721+0000","last_became_active":"2024-04-16T12:57:18.897588+0000","last_became_peered":"2024-04-16T12:57:18.897588+0000","last_unstale":"2024-04-16T12:57:19.895721+0000","last_undegraded":"2024-04-16T12:57:19.895721+0000","last_fullsized":"2024-04-16T12:57:19.895721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223066+0000","last_change":"2024-04-16T12:57:18.907306+0000","last_active":"2024-04-16T12:57:20.223066+0000","last_peered":"2024-04-16T12:57:20.223066+0000","last_clean":"2024-04-16T12:57:20.223066+0000","last_became_active":"2024-04-16T12:57:18.906414+0000","last_became_peered":"2024-04-16T12:57:18.906414+0000","last_unstale":"2024-04-16T12:57:20.223066+0000","last_undegraded":"2024-04-16T12:57:20.223066+0000","last_fullsized":"2024-04-16T12:57:20.223066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897560+0000","last_change":"2024-04-16T12:57:18.897054+0000","last_active":"2024-04-16T12:57:19.897560+0000","last_peered":"2024-04-16T12:57:19.897560+0000","last_clean":"2024-04-16T12:57:19.897560+0000","last_became_active":"2024-04-16T12:57:18.896790+0000","last_became_peered":"2024-04-16T12:57:18.896790+0000","last_unstale":"2024-04-16T12:57:19.897560+0000","last_undegraded":"2024-04-16T12:57:19.897560+0000","last_fullsized":"2024-04-16T12:57:19.897560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:40:52.405695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900534+0000","last_change":"2024-04-16T12:57:18.904093+0000","last_active":"2024-04-16T12:57:19.900534+0000","last_peered":"2024-04-16T12:57:19.900534+0000","last_clean":"2024-04-16T12:57:19.900534+0000","last_became_active":"2024-04-16T12:57:18.903830+0000","last_became_peered":"2024-04-16T12:57:18.903830+0000","last_unstale":"2024-04-16T12:57:19.900534+0000","last_undegraded":"2024-04-16T12:57:19.900534+0000","last_fullsized":"2024-04-16T12:57:19.900534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900379+0000","last_change":"2024-04-16T12:57:18.906220+0000","last_active":"2024-04-16T12:57:19.900379+0000","last_peered":"2024-04-16T12:57:19.900379+0000","last_clean":"2024-04-16T12:57:19.900379+0000","last_became_active":"2024-04-16T12:57:18.905952+0000","last_became_peered":"2024-04-16T12:57:18.905952+0000","last_unstale":"2024-04-16T12:57:19.900379+0000","last_undegraded":"2024-04-16T12:57:19.900379+0000","last_fullsized":"2024-04-16T12:57:19.900379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223666+0000","last_change":"2024-04-16T12:57:18.903800+0000","last_active":"2024-04-16T12:57:20.223666+0000","last_peered":"2024-04-16T12:57:20.223666+0000","last_clean":"2024-04-16T12:57:20.223666+0000","last_became_active":"2024-04-16T12:57:18.903405+0000","last_became_peered":"2024-04-16T12:57:18.903405+0000","last_unstale":"2024-04-16T12:57:20.223666+0000","last_undegraded":"2024-04-16T12:57:20.223666+0000","last_fullsized":"2024-04-16T12:57:20.223666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:57.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223545+0000","last_change":"2024-04-16T12:57:18.907729+0000","last_active":"2024-04-16T12:57:20.223545+0000","last_peered":"2024-04-16T12:57:20.223545+0000","last_clean":"2024-04-16T12:57:20.223545+0000","last_became_active":"2024-04-16T12:57:18.907443+0000","last_became_peered":"2024-04-16T12:57:18.907443+0000","last_unstale":"2024-04-16T12:57:20.223545+0000","last_undegraded":"2024-04-16T12:57:20.223545+0000","last_fullsized":"2024-04-16T12:57:20.223545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997595+0000","last_change":"2024-04-16T12:57:18.901384+0000","last_active":"2024-04-16T12:57:19.997595+0000","last_peered":"2024-04-16T12:57:19.997595+0000","last_clean":"2024-04-16T12:57:19.997595+0000","last_became_active":"2024-04-16T12:57:18.900950+0000","last_became_peered":"2024-04-16T12:57:18.900950+0000","last_unstale":"2024-04-16T12:57:19.997595+0000","last_undegraded":"2024-04-16T12:57:19.997595+0000","last_fullsized":"2024-04-16T12:57:19.997595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895404+0000","last_change":"2024-04-16T12:57:18.895285+0000","last_active":"2024-04-16T12:57:19.895404+0000","last_peered":"2024-04-16T12:57:19.895404+0000","last_clean":"2024-04-16T12:57:19.895404+0000","last_became_active":"2024-04-16T12:57:18.895021+0000","last_became_peered":"2024-04-16T12:57:18.895021+0000","last_unstale":"2024-04-16T12:57:19.895404+0000","last_undegraded":"2024-04-16T12:57:19.895404+0000","last_fullsized":"2024-04-16T12:57:19.895404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896228+0000","last_change":"2024-04-16T12:57:18.901159+0000","last_active":"2024-04-16T12:57:19.896228+0000","last_peered":"2024-04-16T12:57:19.896228+0000","last_clean":"2024-04-16T12:57:19.896228+0000","last_became_active":"2024-04-16T12:57:18.899815+0000","last_became_peered":"2024-04-16T12:57:18.899815+0000","last_unstale":"2024-04-16T12:57:19.896228+0000","last_undegraded":"2024-04-16T12:57:19.896228+0000","last_fullsized":"2024-04-16T12:57:19.896228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896069+0000","last_change":"2024-04-16T12:57:18.899890+0000","last_active":"2024-04-16T12:57:19.896069+0000","last_peered":"2024-04-16T12:57:19.896069+0000","last_clean":"2024-04-16T12:57:19.896069+0000","last_became_active":"2024-04-16T12:57:18.899220+0000","last_became_peered":"2024-04-16T12:57:18.899220+0000","last_unstale":"2024-04-16T12:57:19.896069+0000","last_undegraded":"2024-04-16T12:57:19.896069+0000","last_fullsized":"2024-04-16T12:57:19.896069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223149+0000","last_change":"2024-04-16T12:57:18.895161+0000","last_active":"2024-04-16T12:57:20.223149+0000","last_peered":"2024-04-16T12:57:20.223149+0000","last_clean":"2024-04-16T12:57:20.223149+0000","last_became_active":"2024-04-16T12:57:18.894866+0000","last_became_peered":"2024-04-16T12:57:18.894866+0000","last_unstale":"2024-04-16T12:57:20.223149+0000","last_undegraded":"2024-04-16T12:57:20.223149+0000","last_fullsized":"2024-04-16T12:57:20.223149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:57.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897382+0000","last_change":"2024-04-16T12:57:18.896070+0000","last_active":"2024-04-16T12:57:19.897382+0000","last_peered":"2024-04-16T12:57:19.897382+0000","last_clean":"2024-04-16T12:57:19.897382+0000","last_became_active":"2024-04-16T12:57:18.895789+0000","last_became_peered":"2024-04-16T12:57:18.895789+0000","last_unstale":"2024-04-16T12:57:19.897382+0000","last_undegraded":"2024-04-16T12:57:19.897382+0000","last_fullsized":"2024-04-16T12:57:19.897382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:21.800505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900341+0000","last_change":"2024-04-16T12:57:18.902194+0000","last_active":"2024-04-16T12:57:19.900341+0000","last_peered":"2024-04-16T12:57:19.900341+0000","last_clean":"2024-04-16T12:57:19.900341+0000","last_became_active":"2024-04-16T12:57:18.901578+0000","last_became_peered":"2024-04-16T12:57:18.901578+0000","last_unstale":"2024-04-16T12:57:19.900341+0000","last_undegraded":"2024-04-16T12:57:19.900341+0000","last_fullsized":"2024-04-16T12:57:19.900341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997857+0000","last_change":"2024-04-16T12:57:18.904634+0000","last_active":"2024-04-16T12:57:19.997857+0000","last_peered":"2024-04-16T12:57:19.997857+0000","last_clean":"2024-04-16T12:57:19.997857+0000","last_became_active":"2024-04-16T12:57:18.904143+0000","last_became_peered":"2024-04-16T12:57:18.904143+0000","last_unstale":"2024-04-16T12:57:19.997857+0000","last_undegraded":"2024-04-16T12:57:19.997857+0000","last_fullsized":"2024-04-16T12:57:19.997857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896620+0000","last_change":"2024-04-16T12:57:18.902458+0000","last_active":"2024-04-16T12:57:19.896620+0000","last_peered":"2024-04-16T12:57:19.896620+0000","last_clean":"2024-04-16T12:57:19.896620+0000","last_became_active":"2024-04-16T12:57:18.901188+0000","last_became_peered":"2024-04-16T12:57:18.901188+0000","last_unstale":"2024-04-16T12:57:19.896620+0000","last_undegraded":"2024-04-16T12:57:19.896620+0000","last_fullsized":"2024-04-16T12:57:19.896620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:40:52.405695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223334+0000","last_change":"2024-04-16T12:57:18.909655+0000","last_active":"2024-04-16T12:57:20.223334+0000","last_peered":"2024-04-16T12:57:20.223334+0000","last_clean":"2024-04-16T12:57:20.223334+0000","last_became_active":"2024-04-16T12:57:18.909392+0000","last_became_peered":"2024-04-16T12:57:18.909392+0000","last_unstale":"2024-04-16T12:57:20.223334+0000","last_undegraded":"2024-04-16T12:57:20.223334+0000","last_fullsized":"2024-04-16T12:57:20.223334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896552+0000","last_change":"2024-04-16T12:57:18.901325+0000","last_active":"2024-04-16T12:57:19.896552+0000","last_peered":"2024-04-16T12:57:19.896552+0000","last_clean":"2024-04-16T12:57:19.896552+0000","last_became_active":"2024-04-16T12:57:18.900839+0000","last_became_peered":"2024-04-16T12:57:18.900839+0000","last_unstale":"2024-04-16T12:57:19.896552+0000","last_undegraded":"2024-04-16T12:57:19.896552+0000","last_fullsized":"2024-04-16T12:57:19.896552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:21.800505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223740+0000","last_change":"2024-04-16T12:57:18.912510+0000","last_active":"2024-04-16T12:57:20.223740+0000","last_peered":"2024-04-16T12:57:20.223740+0000","last_clean":"2024-04-16T12:57:20.223740+0000","last_became_active":"2024-04-16T12:57:18.912214+0000","last_became_peered":"2024-04-16T12:57:18.912214+0000","last_unstale":"2024-04-16T12:57:20.223740+0000","last_undegraded":"2024-04-16T12:57:20.223740+0000","last_fullsized":"2024-04-16T12:57:20.223740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900599+0000","last_change":"2024-04-16T12:57:18.898047+0000","last_active":"2024-04-16T12:57:19.900599+0000","last_peered":"2024-04-16T12:57:19.900599+0000","last_clean":"2024-04-16T12:57:19.900599+0000","last_became_active":"2024-04-16T12:57:18.897665+0000","last_became_peered":"2024-04-16T12:57:18.897665+0000","last_unstale":"2024-04-16T12:57:19.900599+0000","last_undegraded":"2024-04-16T12:57:19.900599+0000","last_fullsized":"2024-04-16T12:57:19.900599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895472+0000","last_change":"2024-04-16T12:57:18.899681+0000","last_active":"2024-04-16T12:57:19.895472+0000","last_peered":"2024-04-16T12:57:19.895472+0000","last_clean":"2024-04-16T12:57:19.895472+0000","last_became_active":"2024-04-16T12:57:18.899371+0000","last_became_peered":"2024-04-16T12:57:18.899371+0000","last_unstale":"2024-04-16T12:57:19.895472+0000","last_undegraded":"2024-04-16T12:57:19.895472+0000","last_fullsized":"2024-04-16T12:57:19.895472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223764+0000","last_change":"2024-04-16T12:57:18.907309+0000","last_active":"2024-04-16T12:57:20.223764+0000","last_peered":"2024-04-16T12:57:20.223764+0000","last_clean":"2024-04-16T12:57:20.223764+0000","last_became_active":"2024-04-16T12:57:18.906438+0000","last_became_peered":"2024-04-16T12:57:18.906438+0000","last_unstale":"2024-04-16T12:57:20.223764+0000","last_undegraded":"2024-04-16T12:57:20.223764+0000","last_fullsized":"2024-04-16T12:57:20.223764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997593+0000","last_change":"2024-04-16T12:57:18.900069+0000","last_active":"2024-04-16T12:57:19.997593+0000","last_peered":"2024-04-16T12:57:19.997593+0000","last_clean":"2024-04-16T12:57:19.997593+0000","last_became_active":"2024-04-16T12:57:18.899776+0000","last_became_peered":"2024-04-16T12:57:18.899776+0000","last_unstale":"2024-04-16T12:57:19.997593+0000","last_undegraded":"2024-04-16T12:57:19.997593+0000","last_fullsized":"2024-04-16T12:57:19.997593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:05.692833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897104+0000","last_change":"2024-04-16T12:57:18.902474+0000","last_active":"2024-04-16T12:57:19.897104+0000","last_peered":"2024-04-16T12:57:19.897104+0000","last_clean":"2024-04-16T12:57:19.897104+0000","last_became_active":"2024-04-16T12:57:18.902171+0000","last_became_peered":"2024-04-16T12:57:18.902171+0000","last_unstale":"2024-04-16T12:57:19.897104+0000","last_undegraded":"2024-04-16T12:57:19.897104+0000","last_fullsized":"2024-04-16T12:57:19.897104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:49.068626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223228+0000","last_change":"2024-04-16T12:57:18.897371+0000","last_active":"2024-04-16T12:57:20.223228+0000","last_peered":"2024-04-16T12:57:20.223228+0000","last_clean":"2024-04-16T12:57:20.223228+0000","last_became_active":"2024-04-16T12:57:18.897132+0000","last_became_peered":"2024-04-16T12:57:18.897132+0000","last_unstale":"2024-04-16T12:57:20.223228+0000","last_undegraded":"2024-04-16T12:57:20.223228+0000","last_fullsized":"2024-04-16T12:57:20.223228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:46:42.662630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900198+0000","last_change":"2024-04-16T12:57:18.903430+0000","last_active":"2024-04-16T12:57:19.900198+0000","last_peered":"2024-04-16T12:57:19.900198+0000","last_clean":"2024-04-16T12:57:19.900198+0000","last_became_active":"2024-04-16T12:57:18.903167+0000","last_became_peered":"2024-04-16T12:57:18.903167+0000","last_unstale":"2024-04-16T12:57:19.900198+0000","last_undegraded":"2024-04-16T12:57:19.900198+0000","last_fullsized":"2024-04-16T12:57:19.900198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223458+0000","last_change":"2024-04-16T12:57:18.906576+0000","last_active":"2024-04-16T12:57:20.223458+0000","last_peered":"2024-04-16T12:57:20.223458+0000","last_clean":"2024-04-16T12:57:20.223458+0000","last_became_active":"2024-04-16T12:57:18.906321+0000","last_became_peered":"2024-04-16T12:57:18.906321+0000","last_unstale":"2024-04-16T12:57:20.223458+0000","last_undegraded":"2024-04-16T12:57:20.223458+0000","last_fullsized":"2024-04-16T12:57:20.223458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:19.721593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223780+0000","last_change":"2024-04-16T12:57:17.891624+0000","last_active":"2024-04-16T12:57:20.223780+0000","last_peered":"2024-04-16T12:57:20.223780+0000","last_clean":"2024-04-16T12:57:20.223780+0000","last_became_active":"2024-04-16T12:57:17.891348+0000","last_became_peered":"2024-04-16T12:57:17.891348+0000","last_unstale":"2024-04-16T12:57:20.223780+0000","last_undegraded":"2024-04-16T12:57:20.223780+0000","last_fullsized":"2024-04-16T12:57:20.223780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:08.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997737+0000","last_change":"2024-04-16T12:57:18.899842+0000","last_active":"2024-04-16T12:57:19.997737+0000","last_peered":"2024-04-16T12:57:19.997737+0000","last_clean":"2024-04-16T12:57:19.997737+0000","last_became_active":"2024-04-16T12:57:18.899567+0000","last_became_peered":"2024-04-16T12:57:18.899567+0000","last_unstale":"2024-04-16T12:57:19.997737+0000","last_undegraded":"2024-04-16T12:57:19.997737+0000","last_fullsized":"2024-04-16T12:57:19.997737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900224+0000","last_change":"2024-04-16T12:57:17.897716+0000","last_active":"2024-04-16T12:57:19.900224+0000","last_peered":"2024-04-16T12:57:19.900224+0000","last_clean":"2024-04-16T12:57:19.900224+0000","last_became_active":"2024-04-16T12:57:17.897340+0000","last_became_peered":"2024-04-16T12:57:17.897340+0000","last_unstale":"2024-04-16T12:57:19.900224+0000","last_undegraded":"2024-04-16T12:57:19.900224+0000","last_fullsized":"2024-04-16T12:57:19.900224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223387+0000","last_change":"2024-04-16T12:57:17.897950+0000","last_active":"2024-04-16T12:57:20.223387+0000","last_peered":"2024-04-16T12:57:20.223387+0000","last_clean":"2024-04-16T12:57:20.223387+0000","last_became_active":"2024-04-16T12:57:17.897654+0000","last_became_peered":"2024-04-16T12:57:17.897654+0000","last_unstale":"2024-04-16T12:57:20.223387+0000","last_undegraded":"2024-04-16T12:57:20.223387+0000","last_fullsized":"2024-04-16T12:57:20.223387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223239+0000","last_change":"2024-04-16T12:57:18.904139+0000","last_active":"2024-04-16T12:57:20.223239+0000","last_peered":"2024-04-16T12:57:20.223239+0000","last_clean":"2024-04-16T12:57:20.223239+0000","last_became_active":"2024-04-16T12:57:18.903879+0000","last_became_peered":"2024-04-16T12:57:18.903879+0000","last_unstale":"2024-04-16T12:57:20.223239+0000","last_undegraded":"2024-04-16T12:57:20.223239+0000","last_fullsized":"2024-04-16T12:57:20.223239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896409+0000","last_change":"2024-04-16T12:57:17.892280+0000","last_active":"2024-04-16T12:57:19.896409+0000","last_peered":"2024-04-16T12:57:19.896409+0000","last_clean":"2024-04-16T12:57:19.896409+0000","last_became_active":"2024-04-16T12:57:17.891970+0000","last_became_peered":"2024-04-16T12:57:17.891970+0000","last_unstale":"2024-04-16T12:57:19.896409+0000","last_undegraded":"2024-04-16T12:57:19.896409+0000","last_fullsized":"2024-04-16T12:57:19.896409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895378+0000","last_change":"2024-04-16T12:57:18.898579+0000","last_active":"2024-04-16T12:57:19.895378+0000","last_peered":"2024-04-16T12:57:19.895378+0000","last_clean":"2024-04-16T12:57:19.895378+0000","last_became_active":"2024-04-16T12:57:18.898342+0000","last_became_peered":"2024-04-16T12:57:18.898342+0000","last_unstale":"2024-04-16T12:57:19.895378+0000","last_undegraded":"2024-04-16T12:57:19.895378+0000","last_fullsized":"2024-04-16T12:57:19.895378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900530+0000","last_change":"2024-04-16T12:57:17.903930+0000","last_active":"2024-04-16T12:57:19.900530+0000","last_peered":"2024-04-16T12:57:19.900530+0000","last_clean":"2024-04-16T12:57:19.900530+0000","last_became_active":"2024-04-16T12:57:17.903601+0000","last_became_peered":"2024-04-16T12:57:17.903601+0000","last_unstale":"2024-04-16T12:57:19.900530+0000","last_undegraded":"2024-04-16T12:57:19.900530+0000","last_fullsized":"2024-04-16T12:57:19.900530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895926+0000","last_change":"2024-04-16T12:57:18.903250+0000","last_active":"2024-04-16T12:57:19.895926+0000","last_peered":"2024-04-16T12:57:19.895926+0000","last_clean":"2024-04-16T12:57:19.895926+0000","last_became_active":"2024-04-16T12:57:18.897774+0000","last_became_peered":"2024-04-16T12:57:18.897774+0000","last_unstale":"2024-04-16T12:57:19.895926+0000","last_undegraded":"2024-04-16T12:57:19.895926+0000","last_fullsized":"2024-04-16T12:57:19.895926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896048+0000","last_change":"2024-04-16T12:57:17.901204+0000","last_active":"2024-04-16T12:57:19.896048+0000","last_peered":"2024-04-16T12:57:19.896048+0000","last_clean":"2024-04-16T12:57:19.896048+0000","last_became_active":"2024-04-16T12:57:17.900178+0000","last_became_peered":"2024-04-16T12:57:17.900178+0000","last_unstale":"2024-04-16T12:57:19.896048+0000","last_undegraded":"2024-04-16T12:57:19.896048+0000","last_fullsized":"2024-04-16T12:57:19.896048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997681+0000","last_change":"2024-04-16T12:57:18.900906+0000","last_active":"2024-04-16T12:57:19.997681+0000","last_peered":"2024-04-16T12:57:19.997681+0000","last_clean":"2024-04-16T12:57:19.997681+0000","last_became_active":"2024-04-16T12:57:18.896865+0000","last_became_peered":"2024-04-16T12:57:18.896865+0000","last_unstale":"2024-04-16T12:57:19.997681+0000","last_undegraded":"2024-04-16T12:57:19.997681+0000","last_fullsized":"2024-04-16T12:57:19.997681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895655+0000","last_change":"2024-04-16T12:57:17.904087+0000","last_active":"2024-04-16T12:57:19.895655+0000","last_peered":"2024-04-16T12:57:19.895655+0000","last_clean":"2024-04-16T12:57:19.895655+0000","last_became_active":"2024-04-16T12:57:17.903731+0000","last_became_peered":"2024-04-16T12:57:17.903731+0000","last_unstale":"2024-04-16T12:57:19.895655+0000","last_undegraded":"2024-04-16T12:57:19.895655+0000","last_fullsized":"2024-04-16T12:57:19.895655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223665+0000","last_change":"2024-04-16T12:57:18.900730+0000","last_active":"2024-04-16T12:57:20.223665+0000","last_peered":"2024-04-16T12:57:20.223665+0000","last_clean":"2024-04-16T12:57:20.223665+0000","last_became_active":"2024-04-16T12:57:18.899959+0000","last_became_peered":"2024-04-16T12:57:18.899959+0000","last_unstale":"2024-04-16T12:57:20.223665+0000","last_undegraded":"2024-04-16T12:57:20.223665+0000","last_fullsized":"2024-04-16T12:57:20.223665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:46:42.662630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900311+0000","last_change":"2024-04-16T12:57:17.903883+0000","last_active":"2024-04-16T12:57:19.900311+0000","last_peered":"2024-04-16T12:57:19.900311+0000","last_clean":"2024-04-16T12:57:19.900311+0000","last_became_active":"2024-04-16T12:57:17.903572+0000","last_became_peered":"2024-04-16T12:57:17.903572+0000","last_unstale":"2024-04-16T12:57:19.900311+0000","last_undegraded":"2024-04-16T12:57:19.900311+0000","last_fullsized":"2024-04-16T12:57:19.900311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897063+0000","last_change":"2024-04-16T12:57:18.899095+0000","last_active":"2024-04-16T12:57:19.897063+0000","last_peered":"2024-04-16T12:57:19.897063+0000","last_clean":"2024-04-16T12:57:19.897063+0000","last_became_active":"2024-04-16T12:57:18.898825+0000","last_became_peered":"2024-04-16T12:57:18.898825+0000","last_unstale":"2024-04-16T12:57:19.897063+0000","last_undegraded":"2024-04-16T12:57:19.897063+0000","last_fullsized":"2024-04-16T12:57:19.897063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:16.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997825+0000","last_change":"2024-04-16T12:57:17.903777+0000","last_active":"2024-04-16T12:57:19.997825+0000","last_peered":"2024-04-16T12:57:19.997825+0000","last_clean":"2024-04-16T12:57:19.997825+0000","last_became_active":"2024-04-16T12:57:17.903478+0000","last_became_peered":"2024-04-16T12:57:17.903478+0000","last_unstale":"2024-04-16T12:57:19.997825+0000","last_undegraded":"2024-04-16T12:57:19.997825+0000","last_fullsized":"2024-04-16T12:57:19.997825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:57:14.224709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997484+0000","last_change":"2024-04-16T12:57:18.903190+0000","last_active":"2024-04-16T12:57:19.997484+0000","last_peered":"2024-04-16T12:57:19.997484+0000","last_clean":"2024-04-16T12:57:19.997484+0000","last_became_active":"2024-04-16T12:57:18.902934+0000","last_became_peered":"2024-04-16T12:57:18.902934+0000","last_unstale":"2024-04-16T12:57:19.997484+0000","last_undegraded":"2024-04-16T12:57:19.997484+0000","last_fullsized":"2024-04-16T12:57:19.997484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:37.114869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897144+0000","last_change":"2024-04-16T12:57:17.902218+0000","last_active":"2024-04-16T12:57:19.897144+0000","last_peered":"2024-04-16T12:57:19.897144+0000","last_clean":"2024-04-16T12:57:19.897144+0000","last_became_active":"2024-04-16T12:57:17.901896+0000","last_became_peered":"2024-04-16T12:57:17.901896+0000","last_unstale":"2024-04-16T12:57:19.897144+0000","last_undegraded":"2024-04-16T12:57:19.897144+0000","last_fullsized":"2024-04-16T12:57:19.897144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896906+0000","last_change":"2024-04-16T12:57:18.900704+0000","last_active":"2024-04-16T12:57:19.896906+0000","last_peered":"2024-04-16T12:57:19.896906+0000","last_clean":"2024-04-16T12:57:19.896906+0000","last_became_active":"2024-04-16T12:57:18.900420+0000","last_became_peered":"2024-04-16T12:57:18.900420+0000","last_unstale":"2024-04-16T12:57:19.896906+0000","last_undegraded":"2024-04-16T12:57:19.896906+0000","last_fullsized":"2024-04-16T12:57:19.896906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900170+0000","last_change":"2024-04-16T12:57:17.901200+0000","last_active":"2024-04-16T12:57:19.900170+0000","last_peered":"2024-04-16T12:57:19.900170+0000","last_clean":"2024-04-16T12:57:19.900170+0000","last_became_active":"2024-04-16T12:57:17.900900+0000","last_became_peered":"2024-04-16T12:57:17.900900+0000","last_unstale":"2024-04-16T12:57:19.900170+0000","last_undegraded":"2024-04-16T12:57:19.900170+0000","last_fullsized":"2024-04-16T12:57:19.900170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900247+0000","last_change":"2024-04-16T12:57:18.901730+0000","last_active":"2024-04-16T12:57:19.900247+0000","last_peered":"2024-04-16T12:57:19.900247+0000","last_clean":"2024-04-16T12:57:19.900247+0000","last_became_active":"2024-04-16T12:57:18.901341+0000","last_became_peered":"2024-04-16T12:57:18.901341+0000","last_unstale":"2024-04-16T12:57:19.900247+0000","last_undegraded":"2024-04-16T12:57:19.900247+0000","last_fullsized":"2024-04-16T12:57:19.900247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223017+0000","last_change":"2024-04-16T12:57:17.897292+0000","last_active":"2024-04-16T12:57:20.223017+0000","last_peered":"2024-04-16T12:57:20.223017+0000","last_clean":"2024-04-16T12:57:20.223017+0000","last_became_active":"2024-04-16T12:57:17.896999+0000","last_became_peered":"2024-04-16T12:57:17.896999+0000","last_unstale":"2024-04-16T12:57:20.223017+0000","last_undegraded":"2024-04-16T12:57:20.223017+0000","last_fullsized":"2024-04-16T12:57:20.223017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895645+0000","last_change":"2024-04-16T12:57:18.896129+0000","last_active":"2024-04-16T12:57:19.895645+0000","last_peered":"2024-04-16T12:57:19.895645+0000","last_clean":"2024-04-16T12:57:19.895645+0000","last_became_active":"2024-04-16T12:57:18.895812+0000","last_became_peered":"2024-04-16T12:57:18.895812+0000","last_unstale":"2024-04-16T12:57:19.895645+0000","last_undegraded":"2024-04-16T12:57:19.895645+0000","last_fullsized":"2024-04-16T12:57:19.895645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223695+0000","last_change":"2024-04-16T12:57:17.905436+0000","last_active":"2024-04-16T12:57:20.223695+0000","last_peered":"2024-04-16T12:57:20.223695+0000","last_clean":"2024-04-16T12:57:20.223695+0000","last_became_active":"2024-04-16T12:57:17.905189+0000","last_became_peered":"2024-04-16T12:57:17.905189+0000","last_unstale":"2024-04-16T12:57:20.223695+0000","last_undegraded":"2024-04-16T12:57:20.223695+0000","last_fullsized":"2024-04-16T12:57:20.223695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:57:14.224709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896980+0000","last_change":"2024-04-16T12:57:18.893937+0000","last_active":"2024-04-16T12:57:19.896980+0000","last_peered":"2024-04-16T12:57:19.896980+0000","last_clean":"2024-04-16T12:57:19.896980+0000","last_became_active":"2024-04-16T12:57:18.893558+0000","last_became_peered":"2024-04-16T12:57:18.893558+0000","last_unstale":"2024-04-16T12:57:19.896980+0000","last_undegraded":"2024-04-16T12:57:19.896980+0000","last_fullsized":"2024-04-16T12:57:19.896980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223442+0000","last_change":"2024-04-16T12:57:17.896413+0000","last_active":"2024-04-16T12:57:20.223442+0000","last_peered":"2024-04-16T12:57:20.223442+0000","last_clean":"2024-04-16T12:57:20.223442+0000","last_became_active":"2024-04-16T12:57:17.896134+0000","last_became_peered":"2024-04-16T12:57:17.896134+0000","last_unstale":"2024-04-16T12:57:20.223442+0000","last_undegraded":"2024-04-16T12:57:20.223442+0000","last_fullsized":"2024-04-16T12:57:20.223442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897649+0000","last_change":"2024-04-16T12:57:18.896924+0000","last_active":"2024-04-16T12:57:19.897649+0000","last_peered":"2024-04-16T12:57:19.897649+0000","last_clean":"2024-04-16T12:57:19.897649+0000","last_became_active":"2024-04-16T12:57:18.896402+0000","last_became_peered":"2024-04-16T12:57:18.896402+0000","last_unstale":"2024-04-16T12:57:19.897649+0000","last_undegraded":"2024-04-16T12:57:19.897649+0000","last_fullsized":"2024-04-16T12:57:19.897649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:49.068626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895731+0000","last_change":"2024-04-16T12:57:17.898110+0000","last_active":"2024-04-16T12:57:19.895731+0000","last_peered":"2024-04-16T12:57:19.895731+0000","last_clean":"2024-04-16T12:57:19.895731+0000","last_became_active":"2024-04-16T12:57:17.897814+0000","last_became_peered":"2024-04-16T12:57:17.897814+0000","last_unstale":"2024-04-16T12:57:19.895731+0000","last_undegraded":"2024-04-16T12:57:19.895731+0000","last_fullsized":"2024-04-16T12:57:19.895731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896466+0000","last_change":"2024-04-16T12:57:18.907293+0000","last_active":"2024-04-16T12:57:19.896466+0000","last_peered":"2024-04-16T12:57:19.896466+0000","last_clean":"2024-04-16T12:57:19.896466+0000","last_became_active":"2024-04-16T12:57:18.906995+0000","last_became_peered":"2024-04-16T12:57:18.906995+0000","last_unstale":"2024-04-16T12:57:19.896466+0000","last_undegraded":"2024-04-16T12:57:19.896466+0000","last_fullsized":"2024-04-16T12:57:19.896466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.051530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223511+0000","last_change":"2024-04-16T12:57:17.895622+0000","last_active":"2024-04-16T12:57:20.223511+0000","last_peered":"2024-04-16T12:57:20.223511+0000","last_clean":"2024-04-16T12:57:20.223511+0000","last_became_active":"2024-04-16T12:57:17.895299+0000","last_became_peered":"2024-04-16T12:57:17.895299+0000","last_unstale":"2024-04-16T12:57:20.223511+0000","last_undegraded":"2024-04-16T12:57:20.223511+0000","last_fullsized":"2024-04-16T12:57:20.223511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897213+0000","last_change":"2024-04-16T12:57:18.897653+0000","last_active":"2024-04-16T12:57:19.897213+0000","last_peered":"2024-04-16T12:57:19.897213+0000","last_clean":"2024-04-16T12:57:19.897213+0000","last_became_active":"2024-04-16T12:57:18.897367+0000","last_became_peered":"2024-04-16T12:57:18.897367+0000","last_unstale":"2024-04-16T12:57:19.897213+0000","last_undegraded":"2024-04-16T12:57:19.897213+0000","last_fullsized":"2024-04-16T12:57:19.897213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.051530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895537+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:19.895537+0000","last_peered":"2024-04-16T12:57:19.895537+0000","last_clean":"2024-04-16T12:57:19.895537+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:19.895537+0000","last_undegraded":"2024-04-16T12:57:19.895537+0000","last_fullsized":"2024-04-16T12:57:19.895537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895665+0000","last_change":"2024-04-16T12:57:17.902517+0000","last_active":"2024-04-16T12:57:19.895665+0000","last_peered":"2024-04-16T12:57:19.895665+0000","last_clean":"2024-04-16T12:57:19.895665+0000","last_became_active":"2024-04-16T12:57:17.902160+0000","last_became_peered":"2024-04-16T12:57:17.902160+0000","last_unstale":"2024-04-16T12:57:19.895665+0000","last_undegraded":"2024-04-16T12:57:19.895665+0000","last_fullsized":"2024-04-16T12:57:19.895665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223681+0000","last_change":"2024-04-16T12:57:18.906944+0000","last_active":"2024-04-16T12:57:20.223681+0000","last_peered":"2024-04-16T12:57:20.223681+0000","last_clean":"2024-04-16T12:57:20.223681+0000","last_became_active":"2024-04-16T12:57:18.906072+0000","last_became_peered":"2024-04-16T12:57:18.906072+0000","last_unstale":"2024-04-16T12:57:20.223681+0000","last_undegraded":"2024-04-16T12:57:20.223681+0000","last_fullsized":"2024-04-16T12:57:20.223681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895471+0000","last_change":"2024-04-16T12:57:17.898599+0000","last_active":"2024-04-16T12:57:19.895471+0000","last_peered":"2024-04-16T12:57:19.895471+0000","last_clean":"2024-04-16T12:57:19.895471+0000","last_became_active":"2024-04-16T12:57:17.898297+0000","last_became_peered":"2024-04-16T12:57:17.898297+0000","last_unstale":"2024-04-16T12:57:19.895471+0000","last_undegraded":"2024-04-16T12:57:19.895471+0000","last_fullsized":"2024-04-16T12:57:19.895471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997392+0000","last_change":"2024-04-16T12:57:18.900390+0000","last_active":"2024-04-16T12:57:19.997392+0000","last_peered":"2024-04-16T12:57:19.997392+0000","last_clean":"2024-04-16T12:57:19.997392+0000","last_became_active":"2024-04-16T12:57:18.900127+0000","last_became_peered":"2024-04-16T12:57:18.900127+0000","last_unstale":"2024-04-16T12:57:19.997392+0000","last_undegraded":"2024-04-16T12:57:19.997392+0000","last_fullsized":"2024-04-16T12:57:19.997392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:15:47.405509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223323+0000","last_change":"2024-04-16T12:57:17.896418+0000","last_active":"2024-04-16T12:57:20.223323+0000","last_peered":"2024-04-16T12:57:20.223323+0000","last_clean":"2024-04-16T12:57:20.223323+0000","last_became_active":"2024-04-16T12:57:17.896171+0000","last_became_peered":"2024-04-16T12:57:17.896171+0000","last_unstale":"2024-04-16T12:57:20.223323+0000","last_undegraded":"2024-04-16T12:57:20.223323+0000","last_fullsized":"2024-04-16T12:57:20.223323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895348+0000","last_change":"2024-04-16T12:57:18.895902+0000","last_active":"2024-04-16T12:57:19.895348+0000","last_peered":"2024-04-16T12:57:19.895348+0000","last_clean":"2024-04-16T12:57:19.895348+0000","last_became_active":"2024-04-16T12:57:18.895646+0000","last_became_peered":"2024-04-16T12:57:18.895646+0000","last_unstale":"2024-04-16T12:57:19.895348+0000","last_undegraded":"2024-04-16T12:57:19.895348+0000","last_fullsized":"2024-04-16T12:57:19.895348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897213+0000","last_change":"2024-04-16T12:57:17.899456+0000","last_active":"2024-04-16T12:57:19.897213+0000","last_peered":"2024-04-16T12:57:19.897213+0000","last_clean":"2024-04-16T12:57:19.897213+0000","last_became_active":"2024-04-16T12:57:17.898313+0000","last_became_peered":"2024-04-16T12:57:17.898313+0000","last_unstale":"2024-04-16T12:57:19.897213+0000","last_undegraded":"2024-04-16T12:57:19.897213+0000","last_fullsized":"2024-04-16T12:57:19.897213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223517+0000","last_change":"2024-04-16T12:57:18.904379+0000","last_active":"2024-04-16T12:57:20.223517+0000","last_peered":"2024-04-16T12:57:20.223517+0000","last_clean":"2024-04-16T12:57:20.223517+0000","last_became_active":"2024-04-16T12:57:18.904118+0000","last_became_peered":"2024-04-16T12:57:18.904118+0000","last_unstale":"2024-04-16T12:57:20.223517+0000","last_undegraded":"2024-04-16T12:57:20.223517+0000","last_fullsized":"2024-04-16T12:57:20.223517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:03.297461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895700+0000","last_change":"2024-04-16T12:57:17.905541+0000","last_active":"2024-04-16T12:57:19.895700+0000","last_peered":"2024-04-16T12:57:19.895700+0000","last_clean":"2024-04-16T12:57:19.895700+0000","last_became_active":"2024-04-16T12:57:17.905253+0000","last_became_peered":"2024-04-16T12:57:17.905253+0000","last_unstale":"2024-04-16T12:57:19.895700+0000","last_undegraded":"2024-04-16T12:57:19.895700+0000","last_fullsized":"2024-04-16T12:57:19.895700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896326+0000","last_change":"2024-04-16T12:57:18.908431+0000","last_active":"2024-04-16T12:57:19.896326+0000","last_peered":"2024-04-16T12:57:19.896326+0000","last_clean":"2024-04-16T12:57:19.896326+0000","last_became_active":"2024-04-16T12:57:18.908069+0000","last_became_peered":"2024-04-16T12:57:18.908069+0000","last_unstale":"2024-04-16T12:57:19.896326+0000","last_undegraded":"2024-04-16T12:57:19.896326+0000","last_fullsized":"2024-04-16T12:57:19.896326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897403+0000","last_change":"2024-04-16T12:57:17.902749+0000","last_active":"2024-04-16T12:57:19.897403+0000","last_peered":"2024-04-16T12:57:19.897403+0000","last_clean":"2024-04-16T12:57:19.897403+0000","last_became_active":"2024-04-16T12:57:17.902368+0000","last_became_peered":"2024-04-16T12:57:17.902368+0000","last_unstale":"2024-04-16T12:57:19.897403+0000","last_undegraded":"2024-04-16T12:57:19.897403+0000","last_fullsized":"2024-04-16T12:57:19.897403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:55.997554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895628+0000","last_change":"2024-04-16T12:57:18.897877+0000","last_active":"2024-04-16T12:57:19.895628+0000","last_peered":"2024-04-16T12:57:19.895628+0000","last_clean":"2024-04-16T12:57:19.895628+0000","last_became_active":"2024-04-16T12:57:18.897246+0000","last_became_peered":"2024-04-16T12:57:18.897246+0000","last_unstale":"2024-04-16T12:57:19.895628+0000","last_undegraded":"2024-04-16T12:57:19.895628+0000","last_fullsized":"2024-04-16T12:57:19.895628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.899642+0000","last_change":"2024-04-16T12:57:17.894217+0000","last_active":"2024-04-16T12:57:19.899642+0000","last_peered":"2024-04-16T12:57:19.899642+0000","last_clean":"2024-04-16T12:57:19.899642+0000","last_became_active":"2024-04-16T12:57:17.893946+0000","last_became_peered":"2024-04-16T12:57:17.893946+0000","last_unstale":"2024-04-16T12:57:19.899642+0000","last_undegraded":"2024-04-16T12:57:19.899642+0000","last_fullsized":"2024-04-16T12:57:19.899642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:02.292438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223783+0000","last_change":"2024-04-16T12:57:18.898378+0000","last_active":"2024-04-16T12:57:20.223783+0000","last_peered":"2024-04-16T12:57:20.223783+0000","last_clean":"2024-04-16T12:57:20.223783+0000","last_became_active":"2024-04-16T12:57:18.898091+0000","last_became_peered":"2024-04-16T12:57:18.898091+0000","last_unstale":"2024-04-16T12:57:20.223783+0000","last_undegraded":"2024-04-16T12:57:20.223783+0000","last_fullsized":"2024-04-16T12:57:20.223783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900585+0000","last_change":"2024-04-16T12:57:17.897818+0000","last_active":"2024-04-16T12:57:19.900585+0000","last_peered":"2024-04-16T12:57:19.900585+0000","last_clean":"2024-04-16T12:57:19.900585+0000","last_became_active":"2024-04-16T12:57:17.897513+0000","last_became_peered":"2024-04-16T12:57:17.897513+0000","last_unstale":"2024-04-16T12:57:19.900585+0000","last_undegraded":"2024-04-16T12:57:19.900585+0000","last_fullsized":"2024-04-16T12:57:19.900585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997652+0000","last_change":"2024-04-16T12:57:18.902147+0000","last_active":"2024-04-16T12:57:19.997652+0000","last_peered":"2024-04-16T12:57:19.997652+0000","last_clean":"2024-04-16T12:57:19.997652+0000","last_became_active":"2024-04-16T12:57:18.901853+0000","last_became_peered":"2024-04-16T12:57:18.901853+0000","last_unstale":"2024-04-16T12:57:19.997652+0000","last_undegraded":"2024-04-16T12:57:19.997652+0000","last_fullsized":"2024-04-16T12:57:19.997652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895498+0000","last_change":"2024-04-16T12:57:17.905371+0000","last_active":"2024-04-16T12:57:19.895498+0000","last_peered":"2024-04-16T12:57:19.895498+0000","last_clean":"2024-04-16T12:57:19.895498+0000","last_became_active":"2024-04-16T12:57:17.905116+0000","last_became_peered":"2024-04-16T12:57:17.905116+0000","last_unstale":"2024-04-16T12:57:19.895498+0000","last_undegraded":"2024-04-16T12:57:19.895498+0000","last_fullsized":"2024-04-16T12:57:19.895498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223378+0000","last_change":"2024-04-16T12:57:18.897144+0000","last_active":"2024-04-16T12:57:20.223378+0000","last_peered":"2024-04-16T12:57:20.223378+0000","last_clean":"2024-04-16T12:57:20.223378+0000","last_became_active":"2024-04-16T12:57:18.896856+0000","last_became_peered":"2024-04-16T12:57:18.896856+0000","last_unstale":"2024-04-16T12:57:20.223378+0000","last_undegraded":"2024-04-16T12:57:20.223378+0000","last_fullsized":"2024-04-16T12:57:20.223378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:55.085085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895467+0000","last_change":"2024-04-16T12:57:17.900711+0000","last_active":"2024-04-16T12:57:19.895467+0000","last_peered":"2024-04-16T12:57:19.895467+0000","last_clean":"2024-04-16T12:57:19.895467+0000","last_became_active":"2024-04-16T12:57:17.900310+0000","last_became_peered":"2024-04-16T12:57:17.900310+0000","last_unstale":"2024-04-16T12:57:19.895467+0000","last_undegraded":"2024-04-16T12:57:19.895467+0000","last_fullsized":"2024-04-16T12:57:19.895467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223267+0000","last_change":"2024-04-16T12:57:18.902887+0000","last_active":"2024-04-16T12:57:20.223267+0000","last_peered":"2024-04-16T12:57:20.223267+0000","last_clean":"2024-04-16T12:57:20.223267+0000","last_became_active":"2024-04-16T12:57:18.902472+0000","last_became_peered":"2024-04-16T12:57:18.902472+0000","last_unstale":"2024-04-16T12:57:20.223267+0000","last_undegraded":"2024-04-16T12:57:20.223267+0000","last_fullsized":"2024-04-16T12:57:20.223267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895602+0000","last_change":"2024-04-16T12:57:17.898164+0000","last_active":"2024-04-16T12:57:19.895602+0000","last_peered":"2024-04-16T12:57:19.895602+0000","last_clean":"2024-04-16T12:57:19.895602+0000","last_became_active":"2024-04-16T12:57:17.897830+0000","last_became_peered":"2024-04-16T12:57:17.897830+0000","last_unstale":"2024-04-16T12:57:19.895602+0000","last_undegraded":"2024-04-16T12:57:19.895602+0000","last_fullsized":"2024-04-16T12:57:19.895602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223680+0000","last_change":"2024-04-16T12:57:18.907229+0000","last_active":"2024-04-16T12:57:20.223680+0000","last_peered":"2024-04-16T12:57:20.223680+0000","last_clean":"2024-04-16T12:57:20.223680+0000","last_became_active":"2024-04-16T12:57:18.906470+0000","last_became_peered":"2024-04-16T12:57:18.906470+0000","last_unstale":"2024-04-16T12:57:20.223680+0000","last_undegraded":"2024-04-16T12:57:20.223680+0000","last_fullsized":"2024-04-16T12:57:20.223680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897038+0000","last_change":"2024-04-16T12:57:17.899164+0000","last_active":"2024-04-16T12:57:19.897038+0000","last_peered":"2024-04-16T12:57:19.897038+0000","last_clean":"2024-04-16T12:57:19.897038+0000","last_became_active":"2024-04-16T12:57:17.898085+0000","last_became_peered":"2024-04-16T12:57:17.898085+0000","last_unstale":"2024-04-16T12:57:19.897038+0000","last_undegraded":"2024-04-16T12:57:19.897038+0000","last_fullsized":"2024-04-16T12:57:19.897038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900405+0000","last_change":"2024-04-16T12:57:18.902652+0000","last_active":"2024-04-16T12:57:19.900405+0000","last_peered":"2024-04-16T12:57:19.900405+0000","last_clean":"2024-04-16T12:57:19.900405+0000","last_became_active":"2024-04-16T12:57:18.902392+0000","last_became_peered":"2024-04-16T12:57:18.902392+0000","last_unstale":"2024-04-16T12:57:19.900405+0000","last_undegraded":"2024-04-16T12:57:19.900405+0000","last_fullsized":"2024-04-16T12:57:19.900405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896213+0000","last_change":"2024-04-16T12:57:18.898290+0000","last_active":"2024-04-16T12:57:19.896213+0000","last_peered":"2024-04-16T12:57:19.896213+0000","last_clean":"2024-04-16T12:57:19.896213+0000","last_became_active":"2024-04-16T12:57:18.897987+0000","last_became_peered":"2024-04-16T12:57:18.897987+0000","last_unstale":"2024-04-16T12:57:19.896213+0000","last_undegraded":"2024-04-16T12:57:19.896213+0000","last_fullsized":"2024-04-16T12:57:19.896213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897011+0000","last_change":"2024-04-16T12:57:17.897406+0000","last_active":"2024-04-16T12:57:19.897011+0000","last_peered":"2024-04-16T12:57:19.897011+0000","last_clean":"2024-04-16T12:57:19.897011+0000","last_became_active":"2024-04-16T12:57:17.897092+0000","last_became_peered":"2024-04-16T12:57:17.897092+0000","last_unstale":"2024-04-16T12:57:19.897011+0000","last_undegraded":"2024-04-16T12:57:19.897011+0000","last_fullsized":"2024-04-16T12:57:19.897011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896453+0000","last_change":"2024-04-16T12:57:18.898875+0000","last_active":"2024-04-16T12:57:19.896453+0000","last_peered":"2024-04-16T12:57:19.896453+0000","last_clean":"2024-04-16T12:57:19.896453+0000","last_became_active":"2024-04-16T12:57:18.898620+0000","last_became_peered":"2024-04-16T12:57:18.898620+0000","last_unstale":"2024-04-16T12:57:19.896453+0000","last_undegraded":"2024-04-16T12:57:19.896453+0000","last_fullsized":"2024-04-16T12:57:19.896453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:16.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897291+0000","last_change":"2024-04-16T12:57:17.893648+0000","last_active":"2024-04-16T12:57:19.897291+0000","last_peered":"2024-04-16T12:57:19.897291+0000","last_clean":"2024-04-16T12:57:19.897291+0000","last_became_active":"2024-04-16T12:57:17.893177+0000","last_became_peered":"2024-04-16T12:57:17.893177+0000","last_unstale":"2024-04-16T12:57:19.897291+0000","last_undegraded":"2024-04-16T12:57:19.897291+0000","last_fullsized":"2024-04-16T12:57:19.897291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:02.292438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997690+0000","last_change":"2024-04-16T12:57:18.897038+0000","last_active":"2024-04-16T12:57:19.997690+0000","last_peered":"2024-04-16T12:57:19.997690+0000","last_clean":"2024-04-16T12:57:19.997690+0000","last_became_active":"2024-04-16T12:57:18.896693+0000","last_became_peered":"2024-04-16T12:57:18.896693+0000","last_unstale":"2024-04-16T12:57:19.997690+0000","last_undegraded":"2024-04-16T12:57:19.997690+0000","last_fullsized":"2024-04-16T12:57:19.997690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223881+0000","last_change":"2024-04-16T12:57:17.905286+0000","last_active":"2024-04-16T12:57:20.223881+0000","last_peered":"2024-04-16T12:57:20.223881+0000","last_clean":"2024-04-16T12:57:20.223881+0000","last_became_active":"2024-04-16T12:57:17.904988+0000","last_became_peered":"2024-04-16T12:57:17.904988+0000","last_unstale":"2024-04-16T12:57:20.223881+0000","last_undegraded":"2024-04-16T12:57:20.223881+0000","last_fullsized":"2024-04-16T12:57:20.223881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:44.138685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223821+0000","last_change":"2024-04-16T12:57:18.905616+0000","last_active":"2024-04-16T12:57:20.223821+0000","last_peered":"2024-04-16T12:57:20.223821+0000","last_clean":"2024-04-16T12:57:20.223821+0000","last_became_active":"2024-04-16T12:57:18.905328+0000","last_became_peered":"2024-04-16T12:57:18.905328+0000","last_unstale":"2024-04-16T12:57:20.223821+0000","last_undegraded":"2024-04-16T12:57:20.223821+0000","last_fullsized":"2024-04-16T12:57:20.223821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997793+0000","last_change":"2024-04-16T12:57:17.902362+0000","last_active":"2024-04-16T12:57:19.997793+0000","last_peered":"2024-04-16T12:57:19.997793+0000","last_clean":"2024-04-16T12:57:19.997793+0000","last_became_active":"2024-04-16T12:57:17.902091+0000","last_became_peered":"2024-04-16T12:57:17.902091+0000","last_unstale":"2024-04-16T12:57:19.997793+0000","last_undegraded":"2024-04-16T12:57:19.997793+0000","last_fullsized":"2024-04-16T12:57:19.997793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:44.138685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:57:22.219 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T12:57:22.219 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-16T12:57:22.219 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-16T12:57:22.220 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-16T12:57:22.220 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T12:57:22.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8427088640 1 Processor -- start 2024-04-16T12:57:22.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8427088640 1 -- start start 2024-04-16T12:57:22.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8427088640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f84200bbc60 0x7f84200b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8427088640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f8420152830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8427088640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8420073ec0 con 0x7f842006e650 2024-04-16T12:57:22.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8427088640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f84200b7580 con 0x7f84200bbc60 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8427088640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8420073a10 con 0x7f84200bc040 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8424e24640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f84200bbc60 0x7f84200b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8424e24640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f84200bbc60 0x7f84200b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58194/0 (socket says 172.21.15.106:58194) 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f841ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f842006e650 0x7f842014bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36396/0 (socket says 172.21.15.106:36396) 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.355+0000 7f8424e24640 1 -- 172.21.15.106:0/4248467549 learned_addr learned my addr 172.21.15.106:0/4248467549 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f8425625640 1 --2- 172.21.15.106:0/4248467549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f8420152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f8424e24640 1 -- 172.21.15.106:0/4248467549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 msgr2=0x7f8420152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f8424e24640 1 --2- 172.21.15.106:0/4248467549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f8420152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f8424e24640 1 -- 172.21.15.106:0/4248467549 >> v1:172.21.15.106:6789/0 conn(0x7f842006e650 legacy=0x7f842014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f841f7fe640 1 -- 172.21.15.106:0/4248467549 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201190621 0 0) 0x7f8420073ec0 con 0x7f842006e650 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f8424e24640 1 -- 172.21.15.106:0/4248467549 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8420072bd0 con 0x7f84200bbc60 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f8425625640 1 --2- 172.21.15.106:0/4248467549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f8420152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.356+0000 7f8424e24640 1 --2- 172.21.15.106:0/4248467549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84200bbc60 0x7f84200b60e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8418009870 tx=0x7f841802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ec82747d2103f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f841f7fe640 1 -- 172.21.15.106:0/4248467549 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418035020 con 0x7f84200bbc60 2024-04-16T12:57:22.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f841f7fe640 1 -- 172.21.15.106:0/4248467549 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8418031640 con 0x7f84200bbc60 2024-04-16T12:57:22.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f841f7fe640 1 -- 172.21.15.106:0/4248467549 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841802d040 con 0x7f84200bbc60 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 -- 172.21.15.106:0/4248467549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84200bbc60 msgr2=0x7f84200b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 --2- 172.21.15.106:0/4248467549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84200bbc60 0x7f84200b60e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8418009870 tx=0x7f841802b8f0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 -- 172.21.15.106:0/4248467549 shutdown_connections 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 --2- 172.21.15.106:0/4248467549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f8420152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 --2- 172.21.15.106:0/4248467549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84200bbc60 0x7f84200b60e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 -- 172.21.15.106:0/4248467549 >> 172.21.15.106:0/4248467549 conn(0x7f8420067e20 msgr2=0x7f84200bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 -- 172.21.15.106:0/4248467549 shutdown_connections 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.357+0000 7f8427088640 1 -- 172.21.15.106:0/4248467549 wait complete. 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.358+0000 7f8427088640 1 Processor -- start 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.358+0000 7f8427088640 1 -- start start 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8427088640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842006e650 0x7f84200b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8427088640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84200bbc60 0x7f84201dda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8427088640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f84201ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8427088640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f842014c300 con 0x7f842006e650 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8427088640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f84200b6620 con 0x7f84200bbc60 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8427088640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f842014b500 con 0x7f84200bc040 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842006e650 0x7f84200b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842006e650 0x7f84200b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58208/0 (socket says 172.21.15.106:58208) 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 -- 172.21.15.106:0/4145657384 learned_addr learned my addr 172.21.15.106:0/4145657384 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8425625640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f84201ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 -- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 msgr2=0x7f84201ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f841ffff640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84200bbc60 0x7f84201dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f84201ddfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 -- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84200bbc60 msgr2=0x7f84201dda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84200bbc60 0x7f84201dda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f8424e24640 1 -- 172.21.15.106:0/4145657384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84200b4d60 con 0x7f842006e650 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.359+0000 7f841ffff640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84200bbc60 0x7f84201dda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.360+0000 7f8424e24640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842006e650 0x7f84200b4820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f841802b930 tx=0x7f84180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.360+0000 7f841d7fa640 1 -- 172.21.15.106:0/4145657384 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418040070 con 0x7f842006e650 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.360+0000 7f841d7fa640 1 -- 172.21.15.106:0/4145657384 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84180399f0 con 0x7f842006e650 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.360+0000 7f841d7fa640 1 -- 172.21.15.106:0/4145657384 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418035040 con 0x7f842006e650 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.360+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8420142fd0 con 0x7f842006e650 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.360+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84200b5020 con 0x7f842006e650 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.361+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420068a90 con 0x7f842006e650 2024-04-16T12:57:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.361+0000 7f841d7fa640 1 -- 172.21.15.106:0/4145657384 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f841804b060 con 0x7f842006e650 2024-04-16T12:57:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.362+0000 7f841d7fa640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f840006c8f0 0x7f840006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.362+0000 7f841ffff640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f840006c8f0 0x7f840006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.362+0000 7f841d7fa640 1 -- 172.21.15.106:0/4145657384 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84180ad480 con 0x7f842006e650 2024-04-16T12:57:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.362+0000 7f841ffff640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f840006c8f0 0x7f840006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8410007fd0 tx=0x7f8410009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.366+0000 7f841d7fa640 1 -- 172.21.15.106:0/4145657384 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f841807b940 con 0x7f842006e650 2024-04-16T12:57:22.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.591+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f842014ac10 con 0x7f842006e650 2024-04-16T12:57:22.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.593+0000 7f841d7fa640 1 -- 172.21.15.106:0/4145657384 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174144 (secure 0 0 0) 0x7f841807b240 con 0x7f842006e650 2024-04-16T12:57:22.598 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:22.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f840006c8f0 msgr2=0x7f840006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f840006c8f0 0x7f840006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8410007fd0 tx=0x7f8410009040 comp rx=0 tx=0).stop 2024-04-16T12:57:22.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842006e650 msgr2=0x7f84200b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842006e650 0x7f84200b4820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f841802b930 tx=0x7f84180046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 shutdown_connections 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f840006c8f0 0x7f840006edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84200bc040 0x7f84201ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84200bbc60 0x7f84201dda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 --2- 172.21.15.106:0/4145657384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842006e650 0x7f84200b4820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 >> 172.21.15.106:0/4145657384 conn(0x7f8420067e20 msgr2=0x7f84200b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 shutdown_connections 2024-04-16T12:57:22.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.596+0000 7f8427088640 1 -- 172.21.15.106:0/4145657384 wait complete. 2024-04-16T12:57:22.609 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3856209158},{"type":"v1","addr":"172.21.15.106:6833","nonce":3856209158}]},"active_addr":"172.21.15.106:6833/3856209158","active_change":"2024-04-16T12:56:58.155277+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3663617804}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":2443963834}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":2297811154}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":2325157869}]}]} 2024-04-16T12:57:22.612 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-16T12:57:22.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-16T12:57:22.613 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:22.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.712+0000 7f6481500640 1 Processor -- start 2024-04-16T12:57:22.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.712+0000 7f6481500640 1 -- start start 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f6481500640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f647c0b2970 0x7f647c13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f6481500640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c150410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f6481500640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c0b3a80 con 0x7f647c0bbe20 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f6481500640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f647c1497d0 con 0x7f647c0b2970 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f6481500640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f647c140340 con 0x7f647c13fef0 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f647c0b2970 0x7f647c13f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f647c0b2970 0x7f647c13f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42590/0 (socket says 172.21.15.106:42590) 2024-04-16T12:57:22.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647a7fc640 1 -- 172.21.15.106:0/755385039 learned_addr learned my addr 172.21.15.106:0/755385039 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647b7fe640 1 --2- 172.21.15.106:0/755385039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647a7fc640 1 -- 172.21.15.106:0/755385039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 msgr2=0x7f647c150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647a7fc640 1 --2- 172.21.15.106:0/755385039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647a7fc640 1 -- 172.21.15.106:0/755385039 >> v1:172.21.15.171:6789/0 conn(0x7f647c0bbe20 legacy=0x7f647c1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.713+0000 7f647a7fc640 1 -- 172.21.15.106:0/755385039 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0bc200 con 0x7f647c0b2970 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.714+0000 7f647a7fc640 1 --2- 172.21.15.106:0/755385039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c13f9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f64700098a0 tx=0x7f647002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927a40d26684d624 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.714+0000 7f6479ffb640 1 -- 172.21.15.106:0/755385039 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64700317c0 con 0x7f647c0b2970 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.714+0000 7f6479ffb640 1 -- 172.21.15.106:0/755385039 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6470037070 con 0x7f647c0b2970 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.714+0000 7f6479ffb640 1 -- 172.21.15.106:0/755385039 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470031b80 con 0x7f647c0b2970 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 -- 172.21.15.106:0/755385039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 msgr2=0x7f647c13f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 --2- 172.21.15.106:0/755385039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c13f9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f64700098a0 tx=0x7f647002b860 comp rx=0 tx=0).stop 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 -- 172.21.15.106:0/755385039 shutdown_connections 2024-04-16T12:57:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 --2- 172.21.15.106:0/755385039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 --2- 172.21.15.106:0/755385039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c13f9b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 -- 172.21.15.106:0/755385039 >> 172.21.15.106:0/755385039 conn(0x7f647c067e20 msgr2=0x7f647c0bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 -- 172.21.15.106:0/755385039 shutdown_connections 2024-04-16T12:57:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.715+0000 7f6481500640 1 -- 172.21.15.106:0/755385039 wait complete. 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.716+0000 7f6481500640 1 Processor -- start 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.716+0000 7f6481500640 1 -- start start 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c137de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0bbe20 0x7f647c1decd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c1361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b4590 con 0x7f647c0b2970 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b42b0 con 0x7f647c0bbe20 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0b7960 con 0x7f647c13fef0 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c137de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c137de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42594/0 (socket says 172.21.15.106:42594) 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 -- 172.21.15.106:0/518125126 learned_addr learned my addr 172.21.15.106:0/518125126 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647b7fe640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c1361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647a7fc640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0bbe20 0x7f647c1decd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 -- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 msgr2=0x7f647c1361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c1361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 -- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0bbe20 msgr2=0x7f647c1decd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0bbe20 0x7f647c1decd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 -- 172.21.15.106:0/518125126 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c138320 con 0x7f647c0b2970 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f647affd640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c137de0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f646c00c7c0 tx=0x7f646c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f64637fe640 1 -- 172.21.15.106:0/518125126 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c016020 con 0x7f647c0b2970 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f64637fe640 1 -- 172.21.15.106:0/518125126 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c00aa50 con 0x7f647c0b2970 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c139b10 con 0x7f647c0b2970 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f64637fe640 1 -- 172.21.15.106:0/518125126 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c012420 con 0x7f647c0b2970 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.717+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c143830 con 0x7f647c0b2970 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.719+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c13a280 con 0x7f647c0b2970 2024-04-16T12:57:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.719+0000 7f64637fe640 1 -- 172.21.15.106:0/518125126 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f646c019020 con 0x7f647c0b2970 2024-04-16T12:57:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.719+0000 7f64637fe640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f646806c8f0 0x7f646806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.719+0000 7f647a7fc640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f646806c8f0 0x7f646806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.719+0000 7f64637fe640 1 -- 172.21.15.106:0/518125126 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f646c08b830 con 0x7f647c0b2970 2024-04-16T12:57:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.720+0000 7f647a7fc640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f646806c8f0 0x7f646806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6470036000 tx=0x7f647003d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.724+0000 7f64637fe640 1 -- 172.21.15.106:0/518125126 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f647c13a280 con 0x7f647c0b2970 2024-04-16T12:57:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.902+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f647c0691a0 con 0x7f647c0b2970 2024-04-16T12:57:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.903+0000 7f64637fe640 1 -- 172.21.15.106:0/518125126 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f646c020070 con 0x7f647c0b2970 2024-04-16T12:57:22.906 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:22.906 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f646806c8f0 msgr2=0x7f646806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f646806c8f0 0x7f646806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6470036000 tx=0x7f647003d040 comp rx=0 tx=0).stop 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 msgr2=0x7f647c137de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c137de0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f646c00c7c0 tx=0x7f646c00cc80 comp rx=0 tx=0).stop 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 shutdown_connections 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f646806c8f0 0x7f646806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c13fef0 0x7f647c1361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0bbe20 0x7f647c1decd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 --2- 172.21.15.106:0/518125126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f647c0b2970 0x7f647c137de0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 >> 172.21.15.106:0/518125126 conn(0x7f647c067e20 msgr2=0x7f647c074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 shutdown_connections 2024-04-16T12:57:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:22.905+0000 7f6481500640 1 -- 172.21.15.106:0/518125126 wait complete. 2024-04-16T12:57:22.919 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-16T12:57:22.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:23.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.019+0000 7fcb7f6ba640 1 Processor -- start 2024-04-16T12:57:23.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.019+0000 7fcb7f6ba640 1 -- start start 2024-04-16T12:57:23.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7f6ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 0x7fcb7813e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7f6ba640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcb78147e20 0x7fcb7814b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7f6ba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb780b7660 con 0x7fcb780b4440 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7f6ba640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcb78148e00 con 0x7fcb78147e20 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7f6ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcb780b78d0 con 0x7fcb7813e3d0 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7dc57640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcb780b4440 0x7fcb7814b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59274/0 (socket says 172.21.15.106:59274) 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7dc57640 1 -- 172.21.15.106:0/2749577486 learned_addr learned my addr 172.21.15.106:0/2749577486 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220008115 0 0) 0x7fcb780b7660 con 0x7fcb780b4440 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7d456640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 0x7fcb7813e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb64003520 con 0x7fcb780b4440 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7cc55640 1 --2- 172.21.15.106:0/2749577486 >> v2:172.21.15.171:3300/0 conn(0x7fcb78147e20 0x7fcb7814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3480201854 0 0) 0x7fcb64003520 con 0x7fcb780b4440 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 msgr2=0x7fcb7813e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 0x7fcb7813e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 >> v2:172.21.15.171:3300/0 conn(0x7fcb78147e20 msgr2=0x7fcb7814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 --2- 172.21.15.106:0/2749577486 >> v2:172.21.15.171:3300/0 conn(0x7fcb78147e20 0x7fcb7814b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb78148320 con 0x7fcb780b4440 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fcb70001670 con 0x7fcb780b4440 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 >> v1:172.21.15.106:6789/0 conn(0x7fcb780b4440 legacy=0x7fcb7814b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 0x7fcb64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb64004d40 0x7fcb640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcb78148e00 con 0x7fcb640039e0 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcb780b78d0 con 0x7fcb64004d40 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6400b9f0 con 0x7fcb7813e3d0 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7d456640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.020+0000 7fcb7cc55640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 0x7fcb64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.021+0000 7fcb7dc57640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb64004d40 0x7fcb640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.021+0000 7fcb7d456640 1 -- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 msgr2=0x7fcb64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.021+0000 7fcb7d456640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb7813e3d0 0x7fcb64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.021+0000 7fcb7d456640 1 -- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb64004d40 msgr2=0x7fcb640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.021+0000 7fcb7d456640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb64004d40 0x7fcb640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.021+0000 7fcb7d456640 1 -- 172.21.15.106:0/2749577486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb64003520 con 0x7fcb640039e0 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.021+0000 7fcb7d456640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb64003e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009fc0 tx=0x7fcb64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd91a32e529dcd2d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74039070 con 0x7fcb640039e0 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7402cc20 con 0x7fcb640039e0 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb6ffff640 1 -- 172.21.15.106:0/2749577486 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74009c10 con 0x7fcb640039e0 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/2749577486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 msgr2=0x7fcb64003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb7f6ba640 1 --2- 172.21.15.106:0/2749577486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb64003e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009fc0 tx=0x7fcb64005830 comp rx=0 tx=0).stop 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb7dc57640 1 -- 172.21.15.106:0/2749577486 reap_dead start 2024-04-16T12:57:23.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/2749577486 shutdown_connections 2024-04-16T12:57:23.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/2749577486 >> 172.21.15.106:0/2749577486 conn(0x7fcb78068170 msgr2=0x7fcb780bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/2749577486 shutdown_connections 2024-04-16T12:57:23.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.022+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/2749577486 wait complete. 2024-04-16T12:57:23.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.023+0000 7fcb7f6ba640 1 Processor -- start 2024-04-16T12:57:23.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.023+0000 7fcb7f6ba640 1 -- start start 2024-04-16T12:57:23.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7f6ba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb781438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7f6ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb78145240 0x7fcb781e0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7f6ba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb781405b0 0x7fcb781425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7f6ba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7814c060 con 0x7fcb640039e0 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7f6ba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcb781488e0 con 0x7fcb781405b0 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7f6ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7814c1e0 con 0x7fcb78145240 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb781438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb781438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42610/0 (socket says 172.21.15.106:42610) 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 -- 172.21.15.106:0/4075024002 learned_addr learned my addr 172.21.15.106:0/4075024002 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7cc55640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb78145240 0x7fcb781e0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7dc57640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb781405b0 0x7fcb781425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 -- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb78145240 msgr2=0x7fcb781e0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb78145240 0x7fcb781e0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 -- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb781405b0 msgr2=0x7fcb781425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb781405b0 0x7fcb781425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 -- 172.21.15.106:0/4075024002 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb78144580 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7dc57640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb781405b0 0x7fcb781425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7d456640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb781438b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400e200 tx=0x7fcb74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb6dffb640 1 -- 172.21.15.106:0/4075024002 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74039050 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb6dffb640 1 -- 172.21.15.106:0/4075024002 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7403a040 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb78141240 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.024+0000 7fcb6dffb640 1 -- 172.21.15.106:0/4075024002 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74009c10 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.025+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb78142cd0 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.026+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb78145620 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.026+0000 7fcb6dffb640 1 -- 172.21.15.106:0/4075024002 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb74003bb0 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.026+0000 7fcb6dffb640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.027+0000 7fcb6dffb640 1 -- 172.21.15.106:0/4075024002 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcb740ae3a0 con 0x7fcb640039e0 2024-04-16T12:57:23.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.027+0000 7fcb7cc55640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.027+0000 7fcb7cc55640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb78145d60 tx=0x7fcb68008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.031+0000 7fcb6dffb640 1 -- 172.21.15.106:0/4075024002 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb7407c860 con 0x7fcb640039e0 2024-04-16T12:57:23.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.208+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb78144370 con 0x7fcb640039e0 2024-04-16T12:57:23.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.209+0000 7fcb6dffb640 1 -- 172.21.15.106:0/4075024002 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fcb7407c160 con 0x7fcb640039e0 2024-04-16T12:57:23.212 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:23.212 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:23.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcb5c06c8f0 msgr2=0x7fcb5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb78145d60 tx=0x7fcb68008040 comp rx=0 tx=0).stop 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 msgr2=0x7fcb781438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb781438b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400e200 tx=0x7fcb74009750 comp rx=0 tx=0).stop 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 shutdown_connections 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb781405b0 0x7fcb781425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb78145240 0x7fcb781e0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 --2- 172.21.15.106:0/4075024002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb640039e0 0x7fcb781438b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.211+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 >> 172.21.15.106:0/4075024002 conn(0x7fcb78068170 msgr2=0x7fcb7814b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.212+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 shutdown_connections 2024-04-16T12:57:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.212+0000 7fcb7f6ba640 1 -- 172.21.15.106:0/4075024002 wait complete. 2024-04-16T12:57:23.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-16T12:57:23.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-16T12:57:23.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-16T12:57:23.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-16T12:57:23.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-16T12:57:23.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-16T12:57:23.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-16T12:57:23.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-16T12:57:23.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.400+0000 7fd14007e640 1 Processor -- start 2024-04-16T12:57:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.400+0000 7fd14007e640 1 -- start start 2024-04-16T12:57:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.400+0000 7f0d56f73640 1 Processor -- start 2024-04-16T12:57:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.400+0000 7f0d56f73640 1 -- start start 2024-04-16T12:57:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.400+0000 7f23fb59e640 1 Processor -- start 2024-04-16T12:57:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.400+0000 7f23fb59e640 1 -- start start 2024-04-16T12:57:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd673ed9640 1 Processor -- start 2024-04-16T12:57:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.400+0000 7fa39cbba640 1 Processor -- start 2024-04-16T12:57:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fa39cbba640 1 -- start start 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd14007e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd13809bc40 0x7fd138144e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd14007e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1380af5c0 con 0x7fd138148250 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd14007e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1380b59c0 con 0x7fd1381453c0 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd14007e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd138148630 con 0x7fd13809bc40 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd13de1a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd138148250 0x7fd1380b0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59284/0 (socket says 172.21.15.106:59284) 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd13d619640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd13809bc40 0x7fd138144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd13d619640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd13809bc40 0x7fd138144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42620/0 (socket says 172.21.15.106:42620) 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd13de1a640 1 -- 172.21.15.106:0/2393168461 learned_addr learned my addr 172.21.15.106:0/2393168461 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7f91bc984640 1 Processor -- start 2024-04-16T12:57:23.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7f0d56f73640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d480332a0 0x7f0d480ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7fd673ed9640 1 -- start start 2024-04-16T12:57:23.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f0d55770640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0d4801d740 0x7f0d480d2d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59286/0 (socket says 172.21.15.106:59286) 2024-04-16T12:57:23.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa39cbba640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa39001dfb0 0x7fa3900ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fb59e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f23f4038390 0x7f23f403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fb59e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23f40c4840 0x7f23f4039be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fb59e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f4038770 con 0x7f23f4039780 2024-04-16T12:57:23.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fb59e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f23f403b350 con 0x7f23f40c4840 2024-04-16T12:57:23.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fb59e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f23f4035460 con 0x7f23f4038390 2024-04-16T12:57:23.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd673ed9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd6640d4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd673ed9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd6640ca690 0x7fd6640cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f0d55770640 1 -- 172.21.15.106:0/3343919416 learned_addr learned my addr 172.21.15.106:0/3343919416 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f0d56f73640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4800c740 con 0x7f0d4801d740 2024-04-16T12:57:23.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f0d56f73640 1 -- 172.21.15.106:0/3343919416 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d480cdc80 con 0x7f0d4800c360 2024-04-16T12:57:23.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f0d56f73640 1 -- 172.21.15.106:0/3343919416 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f0d480ce9c0 con 0x7f0d480332a0 2024-04-16T12:57:23.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.401+0000 7f91bc984640 1 -- start start 2024-04-16T12:57:23.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fa59c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f23f4038390 0x7f23f403ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa39cbba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa3900cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd673ed9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd664035430 con 0x7fd6640d1180 2024-04-16T12:57:23.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fa59c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f23f4038390 0x7f23f403ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53576/0 (socket says 172.21.15.106:53576) 2024-04-16T12:57:23.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fa59c640 1 -- 172.21.15.106:0/3933921062 learned_addr learned my addr 172.21.15.106:0/3933921062 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd673ed9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd6640d0cf0 con 0x7fd6640ca690 2024-04-16T12:57:23.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd673ed9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd664038380 con 0x7fd664036b60 2024-04-16T12:57:23.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606238069 0 0) 0x7fd1380af5c0 con 0x7fd138148250 2024-04-16T12:57:23.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd124003520 con 0x7fd138148250 2024-04-16T12:57:23.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd671474640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd6640ca690 0x7fd6640cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd671c75640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd6640d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd671474640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd6640ca690 0x7fd6640cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53592/0 (socket says 172.21.15.106:53592) 2024-04-16T12:57:23.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f80876a0640 1 Processor -- start 2024-04-16T12:57:23.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd671474640 1 -- 172.21.15.106:0/1405384071 learned_addr learned my addr 172.21.15.106:0/1405384071 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa39cbba640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa3900ce490 0x7fa3900c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa39cbba640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa39001fb50 con 0x7fa39001dfb0 2024-04-16T12:57:23.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f0d54f6f640 1 -- 172.21.15.106:0/3343919416 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817274437 0 0) 0x7f0d480cdc80 con 0x7f0d4800c360 2024-04-16T12:57:23.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f0d54f6f640 1 -- 172.21.15.106:0/3343919416 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d3c003520 con 0x7f0d4800c360 2024-04-16T12:57:23.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa395d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa3900cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa395d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa3900cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:45960/0 (socket says 172.21.15.106:45960) 2024-04-16T12:57:23.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa395d9b640 1 -- 172.21.15.106:0/1593959334 learned_addr learned my addr 172.21.15.106:0/1593959334 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa396d9d640 1 --2- 172.21.15.106:0/1593959334 >> v2:172.21.15.171:3300/0 conn(0x7fa3900ce490 0x7fa3900c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa39cbba640 1 -- 172.21.15.106:0/1593959334 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa39001f8e0 con 0x7fa3900ce490 2024-04-16T12:57:23.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fa39cbba640 1 -- 172.21.15.106:0/1593959334 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa39000c120 con 0x7fa3900cdb10 2024-04-16T12:57:23.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 833004352 0 0) 0x7fd124003520 con 0x7fd138148250 2024-04-16T12:57:23.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f23fa59c640 1 -- 172.21.15.106:0/3933921062 >> v2:172.21.15.106:3300/0 conn(0x7f23f40c4840 msgr2=0x7f23f4039be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f23fa59c640 1 --2- 172.21.15.106:0/3933921062 >> v2:172.21.15.106:3300/0 conn(0x7f23f40c4840 0x7f23f4039be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f23fa59c640 1 -- 172.21.15.106:0/3933921062 >> v1:172.21.15.171:6789/0 conn(0x7f23f4039780 legacy=0x7f23f40c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f2dda372640 1 Processor -- start 2024-04-16T12:57:23.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd671474640 1 -- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 msgr2=0x7fd6640d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd671474640 1 --2- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd6640d4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd671474640 1 -- 172.21.15.106:0/1405384071 >> v1:172.21.15.106:6789/0 conn(0x7fd6640d1180 legacy=0x7fd664035810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd671474640 1 -- 172.21.15.106:0/1405384071 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd664036f40 con 0x7fd6640ca690 2024-04-16T12:57:23.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7f80876a0640 1 -- start start 2024-04-16T12:57:23.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f80876a0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f808014b7d0 0x7f8080153de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f808543c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f80800bdfa0 0x7f8080141dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59290/0 (socket says 172.21.15.106:59290) 2024-04-16T12:57:23.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f808543c640 1 -- 172.21.15.106:0/3125592364 learned_addr learned my addr 172.21.15.106:0/3125592364 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 >> v2:172.21.15.106:3300/0 conn(0x7fd13809bc40 msgr2=0x7fd138144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.402+0000 7fd13ce18640 1 --2- 172.21.15.106:0/2393168461 >> v2:172.21.15.106:3300/0 conn(0x7fd13809bc40 0x7fd138144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 >> v1:172.21.15.171:6789/0 conn(0x7fd1381453c0 legacy=0x7fd13814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1380b5c60 con 0x7fd138148250 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fd130001650 con 0x7fd138148250 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 >> v1:172.21.15.106:6789/0 conn(0x7fd138148250 legacy=0x7fd1380b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1240039b0 0x7fd124003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124004800 0x7fd124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd124005210 0x7fd12400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd138148630 con 0x7fd1240039b0 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd12400c160 con 0x7fd124005210 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd12400c360 con 0x7fd124004800 2024-04-16T12:57:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fd13e61b640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd124005210 0x7fd12400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f23fa59c640 1 -- 172.21.15.106:0/3933921062 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f4035740 con 0x7f23f4038390 2024-04-16T12:57:23.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f91bc984640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806f060 0x7f91b8157b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f91bc984640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b80b7cd0 con 0x7f91b806e780 2024-04-16T12:57:23.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f91bc984640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b80b6b30 con 0x7f91b80722a0 2024-04-16T12:57:23.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f91bc984640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f91b814c460 con 0x7f91b806f060 2024-04-16T12:57:23.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f91b6ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f91b80722a0 0x7f91b80b6270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33532/0 (socket says 172.21.15.106:33532) 2024-04-16T12:57:23.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f91b6ffd640 1 -- 172.21.15.106:0/953913769 learned_addr learned my addr 172.21.15.106:0/953913769 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f91b7fff640 1 --2- 172.21.15.106:0/953913769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806f060 0x7f91b8157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f0d56772640 1 --2- 172.21.15.106:0/3343919416 >> v2:172.21.15.106:3300/0 conn(0x7f0d480332a0 0x7f0d480ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f0d56772640 1 -- 172.21.15.106:0/3343919416 >> v1:172.21.15.171:6789/0 conn(0x7f0d4800c360 legacy=0x7f0d480c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f0d56772640 1 -- 172.21.15.106:0/3343919416 >> v1:172.21.15.106:6789/0 conn(0x7f0d4801d740 legacy=0x7f0d480d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f0d56772640 1 -- 172.21.15.106:0/3343919416 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d480cdf60 con 0x7f0d480332a0 2024-04-16T12:57:23.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fa396d9d640 1 -- 172.21.15.106:0/1593959334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 msgr2=0x7fa3900cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fa396d9d640 1 --2- 172.21.15.106:0/1593959334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa3900cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fa396d9d640 1 -- 172.21.15.106:0/1593959334 >> v2:172.21.15.106:3300/0 conn(0x7fa39001dfb0 msgr2=0x7fa3900ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fa396d9d640 1 --2- 172.21.15.106:0/1593959334 >> v2:172.21.15.106:3300/0 conn(0x7fa39001dfb0 0x7fa3900ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7fa396d9d640 1 -- 172.21.15.106:0/1593959334 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39001e390 con 0x7fa3900ce490 2024-04-16T12:57:23.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd671c75640 1 --2- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd6640d4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:23.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80800be380 con 0x7f80800bdfa0 2024-04-16T12:57:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd13d619640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124004800 0x7fd124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.403+0000 7f2dda372640 1 -- start start 2024-04-16T12:57:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80800b4c30 con 0x7f808014b390 2024-04-16T12:57:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f80800b4fa0 con 0x7f808014b7d0 2024-04-16T12:57:23.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd13e61b640 1 -- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124004800 msgr2=0x7fd124004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd13e61b640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124004800 0x7fd124004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd13e61b640 1 -- 172.21.15.106:0/2393168461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1240039b0 msgr2=0x7fd124003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd13e61b640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1240039b0 0x7fd124003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd13e61b640 1 -- 172.21.15.106:0/2393168461 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1380b5c60 con 0x7fd124005210 2024-04-16T12:57:23.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dda372640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2dd40ac7a0 0x7f2dd40af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dda372640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2dd40b1630 0x7f2dd40afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd13d619640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124004800 0x7fd124004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:23.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd671474640 1 --2- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640ca690 0x7fd6640cab10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd66c06ae40 tx=0x7fd66c0a72a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4687d900e7518c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fa396d9d640 1 --2- 172.21.15.106:0/1593959334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 0x7fa3900c7400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa39003daf0 tx=0x7fa38c02fb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c70430eab00b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f8085c3d640 1 --2- 172.21.15.106:0/3125592364 >> v2:172.21.15.171:3300/0 conn(0x7f808014b7d0 0x7f8080153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f23fa59c640 1 --2- 172.21.15.106:0/3933921062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 0x7f23f403ad30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23f4038bc0 tx=0x7f23f002b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb7fa7f286012a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dda372640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd40b4a70 con 0x7f2dd406c3f0 2024-04-16T12:57:23.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dda372640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd40b0250 con 0x7f2dd40ac7a0 2024-04-16T12:57:23.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f8077fff640 1 -- 172.21.15.106:0/3125592364 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252728785 0 0) 0x7f80800be380 con 0x7f80800bdfa0 2024-04-16T12:57:23.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dda372640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd4073d30 con 0x7f2dd40b1630 2024-04-16T12:57:23.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dd8b6f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2dd40b1630 0x7f2dd40afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dd9b71640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2dd406c3f0 0x7f2dd41475e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33560/0 (socket says 172.21.15.106:33560) 2024-04-16T12:57:23.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dd9b71640 1 -- 172.21.15.106:0/2304283327 learned_addr learned my addr 172.21.15.106:0/2304283327 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fd670c73640 1 -- 172.21.15.106:0/1405384071 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0b4070 con 0x7fd6640ca690 2024-04-16T12:57:23.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f2dd9370640 1 --2- 172.21.15.106:0/2304283327 >> v2:172.21.15.106:3300/0 conn(0x7f2dd40ac7a0 0x7f2dd40af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f8077fff640 1 -- 172.21.15.106:0/3125592364 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f806c003520 con 0x7f80800bdfa0 2024-04-16T12:57:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f91b67fc640 1 -- 172.21.15.106:0/953913769 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763308875 0 0) 0x7f91b80b6b30 con 0x7f91b80722a0 2024-04-16T12:57:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f91b67fc640 1 -- 172.21.15.106:0/953913769 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a0003520 con 0x7f91b80722a0 2024-04-16T12:57:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f91b7fff640 1 -- 172.21.15.106:0/953913769 >> v1:172.21.15.171:6789/0 conn(0x7f91b80722a0 legacy=0x7f91b80b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f91b7fff640 1 -- 172.21.15.106:0/953913769 >> v1:172.21.15.106:6789/0 conn(0x7f91b806e780 legacy=0x7f91b814cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7fa39559a640 1 -- 172.21.15.106:0/1593959334 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0318f0 con 0x7fa3900ce490 2024-04-16T12:57:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.404+0000 7f0d56772640 1 --2- 172.21.15.106:0/3343919416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480332a0 0x7f0d480ce480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d400097a0 tx=0x7f0d4002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d298970f756c017d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f8085c3d640 1 -- 172.21.15.106:0/3125592364 >> v1:172.21.15.171:6789/0 conn(0x7f808014b390 legacy=0x7f80801506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f8085c3d640 1 -- 172.21.15.106:0/3125592364 >> v1:172.21.15.106:6789/0 conn(0x7f80800bdfa0 legacy=0x7f8080141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f8085c3d640 1 -- 172.21.15.106:0/3125592364 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80801424d0 con 0x7f808014b7d0 2024-04-16T12:57:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f91b7fff640 1 -- 172.21.15.106:0/953913769 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b814c740 con 0x7f91b806f060 2024-04-16T12:57:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f2dcbfff640 1 -- 172.21.15.106:0/2304283327 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959838676 0 0) 0x7f2dd40b4a70 con 0x7f2dd406c3f0 2024-04-16T12:57:23.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f2dcbfff640 1 -- 172.21.15.106:0/2304283327 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc0003520 con 0x7f2dd406c3f0 2024-04-16T12:57:23.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f2dd8b6f640 1 -- 172.21.15.106:0/2304283327 >> v2:172.21.15.106:3300/0 conn(0x7f2dd40ac7a0 msgr2=0x7f2dd40af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f2dd8b6f640 1 --2- 172.21.15.106:0/2304283327 >> v2:172.21.15.106:3300/0 conn(0x7f2dd40ac7a0 0x7f2dd40af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f2dd8b6f640 1 -- 172.21.15.106:0/2304283327 >> v1:172.21.15.171:6789/0 conn(0x7f2dd406c3f0 legacy=0x7f2dd41475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f0d54f6f640 1 -- 172.21.15.106:0/3343919416 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40034070 con 0x7f0d480332a0 2024-04-16T12:57:23.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7fa39559a640 1 -- 172.21.15.106:0/1593959334 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38c031a90 con 0x7fa3900ce490 2024-04-16T12:57:23.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7fa39559a640 1 -- 172.21.15.106:0/1593959334 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c031e60 con 0x7fa3900ce490 2024-04-16T12:57:23.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f0d54f6f640 1 -- 172.21.15.106:0/3343919416 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d40030840 con 0x7f0d480332a0 2024-04-16T12:57:23.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f0d54f6f640 1 -- 172.21.15.106:0/3343919416 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40030c30 con 0x7f0d480332a0 2024-04-16T12:57:23.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7fd13e61b640 1 -- 172.21.15.106:0/2393168461 reap_dead start 2024-04-16T12:57:23.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f2dd8b6f640 1 -- 172.21.15.106:0/2304283327 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd40ad060 con 0x7f2dd40b1630 2024-04-16T12:57:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f23f959a640 1 -- 172.21.15.106:0/3933921062 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0034070 con 0x7f23f4038390 2024-04-16T12:57:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7fd13e61b640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd124005210 0x7fd12400b9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1340044b0 tx=0x7fd124005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434c54ec8386dd7e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7fd670c73640 1 -- 172.21.15.106:0/1405384071 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66c0af640 con 0x7fd6640ca690 2024-04-16T12:57:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7fd670c73640 1 -- 172.21.15.106:0/1405384071 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0afa90 con 0x7fd6640ca690 2024-04-16T12:57:23.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.405+0000 7f23f959a640 1 -- 172.21.15.106:0/3933921062 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f0030880 con 0x7f23f4038390 2024-04-16T12:57:23.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f23f959a640 1 -- 172.21.15.106:0/3933921062 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0030c50 con 0x7f23f4038390 2024-04-16T12:57:23.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 -- 172.21.15.106:0/1593959334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 msgr2=0x7fa3900c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 --2- 172.21.15.106:0/1593959334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 0x7fa3900c7400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa39003daf0 tx=0x7fa38c02fb30 comp rx=0 tx=0).stop 2024-04-16T12:57:23.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f91b7fff640 1 --2- 172.21.15.106:0/953913769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806f060 0x7f91b8157b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91a80097d0 tx=0x7f91a802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f792949e126f9fc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134034070 con 0x7fd124005210 2024-04-16T12:57:23.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd134006d70 con 0x7fd124005210 2024-04-16T12:57:23.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fd13ce18640 1 -- 172.21.15.106:0/2393168461 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134004080 con 0x7fd124005210 2024-04-16T12:57:23.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 -- 172.21.15.106:0/1593959334 shutdown_connections 2024-04-16T12:57:23.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 --2- 172.21.15.106:0/1593959334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 0x7fa3900c7400 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f8085c3d640 1 --2- 172.21.15.106:0/3125592364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f808014b7d0 0x7f8080153de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f807c0097a0 tx=0x7f807c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8e7e6eabe5c538 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 --2- 172.21.15.106:0/1593959334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa3900cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 --2- 172.21.15.106:0/1593959334 >> v2:172.21.15.106:3300/0 conn(0x7fa39001dfb0 0x7fa3900ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 -- 172.21.15.106:0/1593959334 >> 172.21.15.106:0/1593959334 conn(0x7fa39000b600 msgr2=0x7fa39000ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f0d56f73640 1 -- 172.21.15.106:0/3343919416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480332a0 msgr2=0x7f0d480ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f0d56f73640 1 --2- 172.21.15.106:0/3343919416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480332a0 0x7f0d480ce480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d400097a0 tx=0x7f0d4002b980 comp rx=0 tx=0).stop 2024-04-16T12:57:23.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f91b67fc640 1 -- 172.21.15.106:0/953913769 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8031780 con 0x7f91b806f060 2024-04-16T12:57:23.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 -- 172.21.15.106:0/1593959334 shutdown_connections 2024-04-16T12:57:23.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fa39cbba640 1 -- 172.21.15.106:0/1593959334 wait complete. 2024-04-16T12:57:23.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f8077fff640 1 -- 172.21.15.106:0/3125592364 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c0315a0 con 0x7f808014b7d0 2024-04-16T12:57:23.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f8077fff640 1 -- 172.21.15.106:0/3125592364 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c037070 con 0x7f808014b7d0 2024-04-16T12:57:23.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f2dd8b6f640 1 --2- 172.21.15.106:0/2304283327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd40b1630 0x7f2dd40afd10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40b27f0 tx=0x7f2dd002b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3c40e13a9e2c14f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fd673ed9640 1 -- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640ca690 msgr2=0x7fd6640cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7fd673ed9640 1 --2- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640ca690 0x7fd6640cab10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd66c06ae40 tx=0x7fd66c0a72a0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f2dcbfff640 1 -- 172.21.15.106:0/2304283327 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0038070 con 0x7f2dd40b1630 2024-04-16T12:57:23.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f2dcbfff640 1 -- 172.21.15.106:0/2304283327 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd0031710 con 0x7f2dd40b1630 2024-04-16T12:57:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd14007e640 1 -- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd124005210 msgr2=0x7fd12400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd14007e640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd124005210 0x7fd12400b9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1340044b0 tx=0x7fd124005830 comp rx=0 tx=0).stop 2024-04-16T12:57:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f2dcbfff640 1 -- 172.21.15.106:0/2304283327 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0031ae0 con 0x7f2dd40b1630 2024-04-16T12:57:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f91b67fc640 1 -- 172.21.15.106:0/953913769 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8037070 con 0x7f91b806f060 2024-04-16T12:57:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.406+0000 7f91b67fc640 1 -- 172.21.15.106:0/953913769 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8031b40 con 0x7f91b806f060 2024-04-16T12:57:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd14007e640 1 -- 172.21.15.106:0/2393168461 shutdown_connections 2024-04-16T12:57:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd14007e640 1 --2- 172.21.15.106:0/2393168461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd124005210 0x7fd12400b9c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd14007e640 1 -- 172.21.15.106:0/2393168461 >> 172.21.15.106:0/2393168461 conn(0x7fd13809c160 msgr2=0x7fd13809c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd673ed9640 1 -- 172.21.15.106:0/1405384071 shutdown_connections 2024-04-16T12:57:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd673ed9640 1 --2- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640ca690 0x7fd6640cab10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd673ed9640 1 --2- 172.21.15.106:0/1405384071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd6640d4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f8077fff640 1 -- 172.21.15.106:0/3125592364 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c031960 con 0x7f808014b7d0 2024-04-16T12:57:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd673ed9640 1 -- 172.21.15.106:0/1405384071 >> 172.21.15.106:0/1405384071 conn(0x7fd66403abf0 msgr2=0x7fd664005e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd14007e640 1 -- 172.21.15.106:0/2393168461 shutdown_connections 2024-04-16T12:57:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd14007e640 1 -- 172.21.15.106:0/2393168461 wait complete. 2024-04-16T12:57:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f23fb59e640 1 -- 172.21.15.106:0/3933921062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 msgr2=0x7f23f403ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f91bc984640 1 -- 172.21.15.106:0/953913769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806f060 msgr2=0x7f91b8157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f91bc984640 1 --2- 172.21.15.106:0/953913769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806f060 0x7f91b8157b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91a80097d0 tx=0x7f91a802b820 comp rx=0 tx=0).stop 2024-04-16T12:57:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f23fb59e640 1 --2- 172.21.15.106:0/3933921062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 0x7f23f403ad30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23f4038bc0 tx=0x7f23f002b9c0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f91bc984640 1 -- 172.21.15.106:0/953913769 shutdown_connections 2024-04-16T12:57:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f91bc984640 1 --2- 172.21.15.106:0/953913769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806f060 0x7f91b8157b20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f91bc984640 1 -- 172.21.15.106:0/953913769 >> 172.21.15.106:0/953913769 conn(0x7f91b809d170 msgr2=0x7f91b809d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f0d56f73640 1 -- 172.21.15.106:0/3343919416 shutdown_connections 2024-04-16T12:57:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f0d56f73640 1 --2- 172.21.15.106:0/3343919416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480332a0 0x7f0d480ce480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f0d56f73640 1 -- 172.21.15.106:0/3343919416 >> 172.21.15.106:0/3343919416 conn(0x7f0d4800b5d0 msgr2=0x7f0d4800b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f808014b7d0 msgr2=0x7f8080153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f80876a0640 1 --2- 172.21.15.106:0/3125592364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f808014b7d0 0x7f8080153de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f807c0097a0 tx=0x7f807c02b840 comp rx=0 tx=0).stop 2024-04-16T12:57:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f91bc984640 1 -- 172.21.15.106:0/953913769 shutdown_connections 2024-04-16T12:57:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f0d56f73640 1 -- 172.21.15.106:0/3343919416 shutdown_connections 2024-04-16T12:57:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7fd673ed9640 1 -- 172.21.15.106:0/1405384071 shutdown_connections 2024-04-16T12:57:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 shutdown_connections 2024-04-16T12:57:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f80876a0640 1 --2- 172.21.15.106:0/3125592364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f808014b7d0 0x7f8080153de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 >> 172.21.15.106:0/3125592364 conn(0x7f8080067dc0 msgr2=0x7f80800bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f0d56f73640 1 -- 172.21.15.106:0/3343919416 wait complete. 2024-04-16T12:57:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f2dda372640 1 -- 172.21.15.106:0/2304283327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd40b1630 msgr2=0x7f2dd40afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f2dda372640 1 --2- 172.21.15.106:0/2304283327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd40b1630 0x7f2dd40afd10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40b27f0 tx=0x7f2dd002b7b0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7fd673ed9640 1 -- 172.21.15.106:0/1405384071 wait complete. 2024-04-16T12:57:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 shutdown_connections 2024-04-16T12:57:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f2dda372640 1 -- 172.21.15.106:0/2304283327 shutdown_connections 2024-04-16T12:57:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f2dda372640 1 --2- 172.21.15.106:0/2304283327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd40b1630 0x7f2dd40afd10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f2dda372640 1 --2- 172.21.15.106:0/2304283327 >> v2:172.21.15.106:3300/0 conn(0x7f2dd40ac7a0 0x7f2dd40af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f2dda372640 1 -- 172.21.15.106:0/2304283327 >> 172.21.15.106:0/2304283327 conn(0x7f2dd406bfe0 msgr2=0x7f2dd40b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f2dda372640 1 -- 172.21.15.106:0/2304283327 shutdown_connections 2024-04-16T12:57:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f2dda372640 1 -- 172.21.15.106:0/2304283327 wait complete. 2024-04-16T12:57:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.407+0000 7f91bc984640 1 -- 172.21.15.106:0/953913769 wait complete. 2024-04-16T12:57:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7fa39cbba640 1 Processor -- start 2024-04-16T12:57:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7fa39cbba640 1 -- start start 2024-04-16T12:57:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f23fb59e640 1 -- 172.21.15.106:0/3933921062 shutdown_connections 2024-04-16T12:57:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f23fb59e640 1 --2- 172.21.15.106:0/3933921062 >> v2:172.21.15.106:3300/0 conn(0x7f23f40c4840 0x7f23f4039be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f23fb59e640 1 --2- 172.21.15.106:0/3933921062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 0x7f23f403ad30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f23fb59e640 1 -- 172.21.15.106:0/3933921062 >> 172.21.15.106:0/3933921062 conn(0x7f23f40086e0 msgr2=0x7f23f403eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fd14007e640 1 Processor -- start 2024-04-16T12:57:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fd14007e640 1 -- start start 2024-04-16T12:57:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f91bc984640 1 Processor -- start 2024-04-16T12:57:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fd673ed9640 1 Processor -- start 2024-04-16T12:57:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39cbba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa39001dfb0 0x7fa390037800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39cbba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa390161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39cbba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 0x7fa3900c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39cbba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa390033470 con 0x7fa39001dfb0 2024-04-16T12:57:23.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f0d56f73640 1 Processor -- start 2024-04-16T12:57:23.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.408+0000 7f80876a0640 1 -- 172.21.15.106:0/3125592364 wait complete. 2024-04-16T12:57:23.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f80876a0640 1 Processor -- start 2024-04-16T12:57:23.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39cbba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa39003c2e0 con 0x7fa3900ce490 2024-04-16T12:57:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39cbba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa39001d290 con 0x7fa3900cdb10 2024-04-16T12:57:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f0d56f73640 1 -- start start 2024-04-16T12:57:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f2dda372640 1 Processor -- start 2024-04-16T12:57:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f2dda372640 1 -- start start 2024-04-16T12:57:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa39001dfb0 0x7fa390037800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa39001dfb0 0x7fa390037800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42680/0 (socket says 172.21.15.106:42680) 2024-04-16T12:57:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa395d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa390161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa39659c640 1 -- 172.21.15.106:0/3386146558 learned_addr learned my addr 172.21.15.106:0/3386146558 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f91bc984640 1 -- start start 2024-04-16T12:57:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fd673ed9640 1 -- start start 2024-04-16T12:57:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7fa396d9d640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 0x7fa3900c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd14007e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124005210 0x7fd1381426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd14007e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd138072570 0x7fd138072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f23fb59e640 1 -- 172.21.15.106:0/3933921062 shutdown_connections 2024-04-16T12:57:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f23fb59e640 1 -- 172.21.15.106:0/3933921062 wait complete. 2024-04-16T12:57:23.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd14007e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd13813d520 0x7fd13813d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f91bc984640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806e780 0x7f91b809fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f91bc984640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b806f060 0x7f91b814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.409+0000 7f80876a0640 1 -- start start 2024-04-16T12:57:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f80876a0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80800bdfa0 0x7f80801d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd13de1a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124005210 0x7fd1381426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd13de1a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124005210 0x7fd1381426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46000/0 (socket says 172.21.15.106:46000) 2024-04-16T12:57:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd13de1a640 1 -- 172.21.15.106:0/3761660252 learned_addr learned my addr 172.21.15.106:0/3761660252 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd14007e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd1380b4ff0 con 0x7fd13813d520 2024-04-16T12:57:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd1380b5f40 con 0x7fd138072570 2024-04-16T12:57:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd138148d20 con 0x7fd124005210 2024-04-16T12:57:23.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f91bc984640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91b80722a0 0x7f91b8148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f80876a0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808014b390 0x7f80800b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f80876a0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f808014b7d0 0x7f80800b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f91bc984640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f91b806f670 con 0x7f91b806f060 2024-04-16T12:57:23.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f0d56f73640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4800c360 0x7f0d4803ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f91bc984640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f91b806f4f0 con 0x7f91b80722a0 2024-04-16T12:57:23.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f2dda372640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd406c3f0 0x7f2dd41cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f2dda372640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40b1630 0x7f2dd40aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f808543c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80800bdfa0 0x7f80801d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f808543c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80800bdfa0 0x7f80801d3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53644/0 (socket says 172.21.15.106:53644) 2024-04-16T12:57:23.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f808543c640 1 -- 172.21.15.106:0/958957803 learned_addr learned my addr 172.21.15.106:0/958957803 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f91bc984640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f91b8158060 con 0x7f91b806e780 2024-04-16T12:57:23.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f2dda372640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd40af420 0x7f2dd41ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f2dda372640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40b2280 con 0x7f2dd40af420 2024-04-16T12:57:23.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f2dda372640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40b1fa0 con 0x7f2dd406c3f0 2024-04-16T12:57:23.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7f2dda372640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd4147cf0 con 0x7f2dd40b1630 2024-04-16T12:57:23.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f80876a0640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f80800b6650 con 0x7f808014b7d0 2024-04-16T12:57:23.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f80876a0640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f80800b43e0 con 0x7f80800bdfa0 2024-04-16T12:57:23.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91b80722a0 0x7f91b8148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91b80722a0 0x7f91b8148d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53646/0 (socket says 172.21.15.106:53646) 2024-04-16T12:57:23.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 -- 172.21.15.106:0/3086886776 learned_addr learned my addr 172.21.15.106:0/3086886776 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f80876a0640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f80800b67d0 con 0x7f808014b390 2024-04-16T12:57:23.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56f73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d4801d740 0x7f0d48155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7fd13d619640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd138072570 0x7fd138072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f2dd9370640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd406c3f0 0x7f2dd41cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f2dd8b6f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40b1630 0x7f2dd40aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56f73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d480332a0 0x7f0d48021280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f2dd8b6f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40b1630 0x7f2dd40aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46002/0 (socket says 172.21.15.106:46002) 2024-04-16T12:57:23.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f2dd8b6f640 1 -- 172.21.15.106:0/2738423237 learned_addr learned my addr 172.21.15.106:0/2738423237 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b77fe640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806e780 0x7f91b809fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d55770640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d4801d740 0x7f0d48155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56f73640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0d480c8030 con 0x7f0d4800c360 2024-04-16T12:57:23.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56f73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0d480cda20 con 0x7f0d4801d740 2024-04-16T12:57:23.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56772640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d480332a0 0x7f0d48021280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56772640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d480332a0 0x7f0d48021280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46026/0 (socket says 172.21.15.106:46026) 2024-04-16T12:57:23.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56772640 1 -- 172.21.15.106:0/450320250 learned_addr learned my addr 172.21.15.106:0/450320250 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0d480c81b0 con 0x7f0d480332a0 2024-04-16T12:57:23.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b6ffd640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b806f060 0x7f91b814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 -- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806e780 msgr2=0x7f91b809fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f0d55f71640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4800c360 0x7f0d4803ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa395d9b640 1 -- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 msgr2=0x7fa3900c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa395d9b640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3900ce490 0x7fa3900c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa395d9b640 1 -- 172.21.15.106:0/3386146558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa39001dfb0 msgr2=0x7fa390037800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa395d9b640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa39001dfb0 0x7fa390037800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa395d9b640 1 -- 172.21.15.106:0/3386146558 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa390161f00 con 0x7fa3900cdb10 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa395d9b640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa390161250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa39802dbb0 tx=0x7fa39806cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398099070 con 0x7fa3900cdb10 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa398071aa0 con 0x7fa3900cdb10 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398090070 con 0x7fa3900cdb10 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.410+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa390009ad0 con 0x7fa3900cdb10 2024-04-16T12:57:23.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa390009410 con 0x7fa3900cdb10 2024-04-16T12:57:23.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806e780 0x7f91b809fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7fd13e61b640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd13813d520 0x7fd13813d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd673ed9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd664159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd673ed9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6640ca690 0x7fd66415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd13de1a640 1 -- 172.21.15.106:0/3761660252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd138072570 msgr2=0x7fd138072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd13de1a640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd138072570 0x7fd138072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd13de1a640 1 -- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd13813d520 msgr2=0x7fd13813d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd13de1a640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd13813d520 0x7fd13813d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd13de1a640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1380b1d10 con 0x7fd124005210 2024-04-16T12:57:23.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f23fb59e640 1 Processor -- start 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f2dd8b6f640 1 -- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd406c3f0 msgr2=0x7f2dd41cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dd8b6f640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd406c3f0 0x7f2dd41cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dd8b6f640 1 -- 172.21.15.106:0/2738423237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd40af420 msgr2=0x7f2dd41ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dd8b6f640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dd40af420 0x7f2dd41ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dd8b6f640 1 -- 172.21.15.106:0/2738423237 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd40adb30 con 0x7f2dd40b1630 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dd9370640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd406c3f0 0x7f2dd41cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dd8b6f640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40b1630 0x7f2dd40aeee0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009890 tx=0x7f2dd00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 -- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b806f060 msgr2=0x7f91b814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0042070 con 0x7f2dd40b1630 2024-04-16T12:57:23.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b806f060 0x7f91b814e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd673ed9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640d1180 0x7fd6641694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd673ed9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640d4990 con 0x7fd6640ca690 2024-04-16T12:57:23.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd671474640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6640ca690 0x7fd66415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd671474640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6640ca690 0x7fd66415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42738/0 (socket says 172.21.15.106:42738) 2024-04-16T12:57:23.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd671474640 1 -- 172.21.15.106:0/423586737 learned_addr learned my addr 172.21.15.106:0/423586737 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd673ed9640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640d4c90 con 0x7fd6640d1180 2024-04-16T12:57:23.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd673ed9640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd664034e00 con 0x7fd664036b60 2024-04-16T12:57:23.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f808543c640 1 -- 172.21.15.106:0/958957803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808014b390 msgr2=0x7f80800b1800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T12:57:23.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f808543c640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808014b390 0x7f80800b1800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f808543c640 1 -- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f808014b7d0 msgr2=0x7f80800b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f808543c640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f808014b7d0 0x7f80800b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f808543c640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80800b3680 con 0x7f80800bdfa0 2024-04-16T12:57:23.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.411+0000 7f91b7fff640 1 -- 172.21.15.106:0/3086886776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b814b6f0 con 0x7f91b80722a0 2024-04-16T12:57:23.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd003d870 con 0x7f2dd40b1630 2024-04-16T12:57:23.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa390005810 con 0x7fa3900cdb10 2024-04-16T12:57:23.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd13de1a640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124005210 0x7fd1381426d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd13000c7f0 tx=0x7fd13000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f23fb59e640 1 -- start start 2024-04-16T12:57:23.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f91b6ffd640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b806f060 0x7f91b814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:23.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f808543c640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80800bdfa0 0x7f80801d3fc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f807800cbc0 tx=0x7f807800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f91b77fe640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91b806e780 0x7f91b809fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:23.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7fd671c75640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd664159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f0d55f71640 1 -- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d480332a0 msgr2=0x7f0d48021280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f0d55f71640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d480332a0 0x7f0d48021280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f0d55f71640 1 -- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d4801d740 msgr2=0x7f0d48155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f0d55f71640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d4801d740 0x7f0d48155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f0d55f71640 1 -- 172.21.15.106:0/450320250 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d48155fd0 con 0x7f0d4800c360 2024-04-16T12:57:23.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.412+0000 7f0d55770640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d4801d740 0x7f0d48155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:23.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd672476640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640d1180 0x7fd6641694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f91b7fff640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91b80722a0 0x7f91b8148d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91a80098f0 tx=0x7f91a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078017070 con 0x7f80800bdfa0 2024-04-16T12:57:23.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f0d55f71640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4800c360 0x7f0d4803ee40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c3c0 tx=0x7f0d4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f80876a0640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808013e3a0 con 0x7f80800bdfa0 2024-04-16T12:57:23.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa39809c070 con 0x7fa3900cdb10 2024-04-16T12:57:23.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130018070 con 0x7fd124005210 2024-04-16T12:57:23.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f80876a0640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80801d4c30 con 0x7f80800bdfa0 2024-04-16T12:57:23.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1300074e0 con 0x7fd124005210 2024-04-16T12:57:23.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130004a00 con 0x7fd124005210 2024-04-16T12:57:23.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807800ad40 con 0x7f80800bdfa0 2024-04-16T12:57:23.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f2dda372640 1 -- 172.21.15.106:0/2738423237 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd4070290 con 0x7f2dd40b1630 2024-04-16T12:57:23.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f2dda372640 1 -- 172.21.15.106:0/2738423237 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd41cec30 con 0x7f2dd40b1630 2024-04-16T12:57:23.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd671474640 1 -- 172.21.15.106:0/423586737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 msgr2=0x7fd664159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c017070 con 0x7f0d4800c360 2024-04-16T12:57:23.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8032610 con 0x7f91b80722a0 2024-04-16T12:57:23.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd671474640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd664036b60 0x7fd664159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0052f0 con 0x7f0d4800c360 2024-04-16T12:57:23.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a80327b0 con 0x7f91b80722a0 2024-04-16T12:57:23.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd671474640 1 -- 172.21.15.106:0/423586737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640d1180 msgr2=0x7fd6641694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd671474640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6640d1180 0x7fd6641694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd671474640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66415a2f0 con 0x7fd6640ca690 2024-04-16T12:57:23.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7fa386ffd640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3780751d0 0x7fa378077690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa398106c20 con 0x7fa3900cdb10 2024-04-16T12:57:23.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0038040 con 0x7f2dd40b1630 2024-04-16T12:57:23.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7fa386ffd640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7fa37807d370 0x7fa37807f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 --> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa398091e50 con 0x7fa37807d370 2024-04-16T12:57:23.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2dd4143ce0 con 0x7f2dd40b1630 2024-04-16T12:57:23.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd138144640 con 0x7fd124005210 2024-04-16T12:57:23.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd138071d70 con 0x7fd124005210 2024-04-16T12:57:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7fa396d9d640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7fa37807d370 0x7fa37807f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7fa39659c640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3780751d0 0x7fa378077690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa3980d0d10 con 0x7fa3900cdb10 2024-04-16T12:57:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078012600 con 0x7f80800bdfa0 2024-04-16T12:57:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f80876a0640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8060001030 con 0x7f80800bdfa0 2024-04-16T12:57:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b81e5d00 con 0x7f91b80722a0 2024-04-16T12:57:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c003830 con 0x7f0d4800c360 2024-04-16T12:57:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7fd671474640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6640ca690 0x7fd66415d340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0635c0 tx=0x7fd66c0657c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d48156580 con 0x7f0d4800c360 2024-04-16T12:57:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b80a0790 con 0x7f91b80722a0 2024-04-16T12:57:23.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4803f8e0 con 0x7f0d4800c360 2024-04-16T12:57:23.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7fa39659c640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3780751d0 0x7fa378077690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa388009a40 tx=0x7fa3880091c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8032b60 con 0x7f91b80722a0 2024-04-16T12:57:23.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0bc070 con 0x7fd6640ca690 2024-04-16T12:57:23.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fb59e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 0x7f23f40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fb59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23f4039780 0x7f23f40bade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fa59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 0x7f23f40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fa59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 0x7f23f40cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53682/0 (socket says 172.21.15.106:53682) 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fb59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f40c4840 0x7f23f4162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23f9d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23f4039780 0x7f23f40bade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23f9d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23f4039780 0x7f23f40bade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46048/0 (socket says 172.21.15.106:46048) 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fa59c640 1 -- 172.21.15.106:0/447229473 learned_addr learned my addr 172.21.15.106:0/447229473 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f23f403a4c0 con 0x7f23f40c4840 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23f403a340 con 0x7f23f4038390 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f23f40d4c60 con 0x7f23f4039780 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.413+0000 7f23fad9d640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f40c4840 0x7f23f4162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f23fad9d640 1 -- 172.21.15.106:0/447229473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23f4039780 msgr2=0x7f23f40bade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f23fad9d640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23f4039780 0x7f23f40bade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f23fad9d640 1 -- 172.21.15.106:0/447229473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 msgr2=0x7f23f40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f23fad9d640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23f4038390 0x7f23f40cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f23fad9d640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f40cdba0 con 0x7f23f40c4840 2024-04-16T12:57:23.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.414+0000 7f23fad9d640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f40c4840 0x7f23f4162f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23ec01c3a0 tx=0x7f23ec01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66c0ae950 con 0x7fd6640ca690 2024-04-16T12:57:23.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.415+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd120001030 con 0x7fd124005210 2024-04-16T12:57:23.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0b4040 con 0x7fd6640ca690 2024-04-16T12:57:23.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7fd673ed9640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66402ab80 con 0x7fd6640ca690 2024-04-16T12:57:23.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f807801a070 con 0x7f80800bdfa0 2024-04-16T12:57:23.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7fd673ed9640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66415db80 con 0x7fd6640ca690 2024-04-16T12:57:23.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91b80691a0 con 0x7f91b80722a0 2024-04-16T12:57:23.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7fa396d9d640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7fa37807d370 0x7fa37807f790 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec026020 con 0x7f23f40c4840 2024-04-16T12:57:23.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec022640 con 0x7f23f40c4840 2024-04-16T12:57:23.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec022a10 con 0x7f23f40c4840 2024-04-16T12:57:23.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f4037f20 con 0x7f23f40c4840 2024-04-16T12:57:23.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f40c4ee0 con 0x7f23f40c4840 2024-04-16T12:57:23.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f8075ffb640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f806406c8f0 0x7f806406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f807808b940 con 0x7f80800bdfa0 2024-04-16T12:57:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.416+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd13001b070 con 0x7fd124005210 2024-04-16T12:57:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7fd12e7fc640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd11c06c990 0x7fd11c06ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd13008b040 con 0x7fd124005210 2024-04-16T12:57:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7fd12e7fc640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7fd11c074b30 0x7fd11c076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd11c077600 con 0x7fd11c074b30 2024-04-16T12:57:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2dd0045070 con 0x7f2dd40b1630 2024-04-16T12:57:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91a8032d00 con 0x7f91b80722a0 2024-04-16T12:57:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f8075ffb640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f8064074b10 0x7f8064076f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f807801ae50 con 0x7f8064074b10 2024-04-16T12:57:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f807808bd30 con 0x7f80800bdfa0 2024-04-16T12:57:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f8084c3b640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f806406c8f0 0x7f806406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd130092050 con 0x7fd124005210 2024-04-16T12:57:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7fd13d619640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd11c06c990 0x7fd11c06ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f8085c3d640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f8064074b10 0x7f8064076f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7fd13e61b640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7fd11c074b30 0x7fd11c076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f2dc9ffb640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2db806c9c0 0x7f2db806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2dd00ad510 con 0x7f2dd40b1630 2024-04-16T12:57:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f2dc9ffb640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f2db8074c40 0x7f2db8077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 --> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dd0008eb0 con 0x7f2db8074c40 2024-04-16T12:57:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2dd00ad900 con 0x7f2dd40b1630 2024-04-16T12:57:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.417+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d48005390 con 0x7f0d4800c360 2024-04-16T12:57:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== osd.7 v2:172.21.15.171:6817/676267245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa398091e50 con 0x7fa37807d370 2024-04-16T12:57:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d4c01a070 con 0x7f0d4800c360 2024-04-16T12:57:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f8084c3b640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f806406c8f0 0x7f806406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80800bb4b0 tx=0x7f80700079d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23e0001030 con 0x7f23f40c4840 2024-04-16T12:57:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f8085c3d640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f8064074b10 0x7f8064076f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7fd13e61b640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7fd11c074b30 0x7fd11c076f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f919ffff640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f91a406c9c0 0x7f91a406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.418+0000 7f2dd9370640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2db806c9c0 0x7f2db806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7fd13d619640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd11c06c990 0x7fd11c06ee50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b4590 tx=0x7fd128008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f91b77fe640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f91a406c9c0 0x7f91a406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f0d467fc640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0d3406c9c0 0x7f0d3406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91a80ada10 con 0x7f91b80722a0 2024-04-16T12:57:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0d4c08ae80 con 0x7f0d4800c360 2024-04-16T12:57:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f919ffff640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7f91a4074c40 0x7f91a4077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 --> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91a80327b0 con 0x7f91a4074c40 2024-04-16T12:57:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f91a80b22a0 con 0x7f91b80722a0 2024-04-16T12:57:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f2dd9370640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2db806c9c0 0x7f2db806ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400d2c0 tx=0x7f2dc4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f0d467fc640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7f0d34074c40 0x7f0d34077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f91b77fe640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f91a406c9c0 0x7f91a406ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91ac007fd0 tx=0x7f91ac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 --> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d4c0054a0 con 0x7f0d34074c40 2024-04-16T12:57:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0d4c08d4e0 con 0x7f0d4800c360 2024-04-16T12:57:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== osd.1 v2:172.21.15.106:6808/809484208 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f807801ae50 con 0x7f8064074b10 2024-04-16T12:57:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f0d55770640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0d3406c9c0 0x7f0d3406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7f91b6ffd640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7f91a4074c40 0x7f91a4077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== osd.2 v2:172.21.15.106:6824/2939840684 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd11c077600 con 0x7fd11c074b30 2024-04-16T12:57:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7f2dd9b71640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f2db8074c40 0x7f2db8077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.419+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd66c0bf070 con 0x7fd6640ca690 2024-04-16T12:57:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7fd673ed9640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd664005390 con 0x7fd6640ca690 2024-04-16T12:57:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7f0d56772640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7f0d34074c40 0x7f0d34077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23ec029020 con 0x7f23f40c4840 2024-04-16T12:57:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7f0d55770640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0d3406c9c0 0x7f0d3406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d50000b60 tx=0x7f0d5006e040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7f91b6ffd640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7f91a4074c40 0x7f91a4077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7fd6627fc640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd65006c9c0 0x7fd65006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd66c128d90 con 0x7fd6640ca690 2024-04-16T12:57:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7f2dd9b71640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f2db8074c40 0x7f2db8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.420+0000 7fd671c75640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd65006c9c0 0x7fd65006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7fd6627fc640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7fd650074c40 0x7fd650077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd66c070f30 con 0x7fd650074c40 2024-04-16T12:57:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd66c12e380 con 0x7fd6640ca690 2024-04-16T12:57:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f23eaffd640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f23dc06c9c0 0x7f23dc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f0d56772640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7f0d34074c40 0x7f0d34077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7fd672476640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7fd650074c40 0x7fd650077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23ec09cd00 con 0x7f23f40c4840 2024-04-16T12:57:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f23eaffd640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7f23dc074c40 0x7f23dc077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23ec01bf40 con 0x7f23dc074c40 2024-04-16T12:57:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f23ec09d0f0 con 0x7f23f40c4840 2024-04-16T12:57:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f23fa59c640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f23dc06c9c0 0x7f23dc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== osd.4 v2:172.21.15.171:6805/37616255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91a80327b0 con 0x7f91a4074c40 2024-04-16T12:57:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f23f9d9b640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7f23dc074c40 0x7f23dc077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== osd.5 v2:172.21.15.171:6800/1858725458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2dd0008eb0 con 0x7f2db8074c40 2024-04-16T12:57:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.421+0000 7fd672476640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7fd650074c40 0x7fd650077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.422+0000 7f23f9d9b640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7f23dc074c40 0x7f23dc077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.422+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== osd.6 v2:172.21.15.171:6816/2241406826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d4c0054a0 con 0x7f0d34074c40 2024-04-16T12:57:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.422+0000 7f23fa59c640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f23dc06c9c0 0x7f23dc06ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009630 tx=0x7f23f003b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.423+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== osd.0 v2:172.21.15.106:6800/912307023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd66c070f30 con 0x7fd650074c40 2024-04-16T12:57:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.423+0000 7fd671c75640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd65006c9c0 0x7fd65006ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd6640ce010 tx=0x7fd668008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.423+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== osd.3 v2:172.21.15.106:6816/2118469111 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23ec01bf40 con 0x7f23dc074c40 2024-04-16T12:57:23.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.452+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 --> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa39001f490 con 0x7fa37807d370 2024-04-16T12:57:23.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.453+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 --> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd120002dd0 con 0x7fd11c074b30 2024-04-16T12:57:23.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.453+0000 7fa386ffd640 1 -- 172.21.15.106:0/3386146558 <== osd.7 v2:172.21.15.171:6817/676267245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa39001f490 con 0x7fa37807d370 2024-04-16T12:57:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.453+0000 7fd12e7fc640 1 -- 172.21.15.106:0/3761660252 <== osd.2 v2:172.21.15.106:6824/2939840684 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd120002dd0 con 0x7fd11c074b30 2024-04-16T12:57:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.453+0000 7f80876a0640 1 -- 172.21.15.106:0/958957803 --> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8060002dd0 con 0x7f8064074b10 2024-04-16T12:57:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.453+0000 7f8075ffb640 1 -- 172.21.15.106:0/958957803 <== osd.1 v2:172.21.15.106:6808/809484208 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8060002dd0 con 0x7f8064074b10 2024-04-16T12:57:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7fd11c074b30 msgr2=0x7fd11c076f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7fd11c074b30 0x7fd11c076f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7fa37807d370 msgr2=0x7fa37807f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7fa37807d370 0x7fa37807f790 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3780751d0 msgr2=0x7fa378077690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3780751d0 0x7fa378077690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa388009a40 tx=0x7fa3880091c0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd11c06c990 msgr2=0x7fd11c06ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd11c06c990 0x7fd11c06ee50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b4590 tx=0x7fd128008040 comp rx=0 tx=0).stop 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 msgr2=0x7fa390161250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 --2- 172.21.15.106:0/3386146558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3900cdb10 0x7fa390161250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa39802dbb0 tx=0x7fa39806cd90 comp rx=0 tx=0).stop 2024-04-16T12:57:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124005210 msgr2=0x7fd1381426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 --2- 172.21.15.106:0/3761660252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd124005210 0x7fd1381426d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd13000c7f0 tx=0x7fd13000ccb0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa396d9d640 1 -- 172.21.15.106:0/3386146558 reap_dead start 2024-04-16T12:57:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 shutdown_connections 2024-04-16T12:57:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 >> 172.21.15.106:0/3386146558 conn(0x7fa39000b600 msgr2=0x7fa3900ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd13e61b640 1 -- 172.21.15.106:0/3761660252 reap_dead start 2024-04-16T12:57:23.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 shutdown_connections 2024-04-16T12:57:23.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fa39cbba640 1 -- 172.21.15.106:0/3386146558 wait complete. 2024-04-16T12:57:23.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 --> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2dd4068a90 con 0x7f2db8074c40 2024-04-16T12:57:23.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 shutdown_connections 2024-04-16T12:57:23.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7f806b7fe640 1 -- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f8064074b10 msgr2=0x7f8064076f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7f806b7fe640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f8064074b10 0x7f8064076f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.454+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 >> 172.21.15.106:0/3761660252 conn(0x7fd13809c160 msgr2=0x7fd13806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 shutdown_connections 2024-04-16T12:57:23.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7fd14007e640 1 -- 172.21.15.106:0/3761660252 wait complete. 2024-04-16T12:57:23.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 -- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f806406c8f0 msgr2=0x7f806406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f806406c8f0 0x7f806406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80800bb4b0 tx=0x7f80700079d0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 --> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d48005390 con 0x7f0d34074c40 2024-04-16T12:57:23.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 -- 172.21.15.106:0/958957803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80800bdfa0 msgr2=0x7f80801d3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 --2- 172.21.15.106:0/958957803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80800bdfa0 0x7f80801d3fc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f807800cbc0 tx=0x7f807800a430 comp rx=0 tx=0).stop 2024-04-16T12:57:23.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f8085c3d640 1 -- 172.21.15.106:0/958957803 reap_dead start 2024-04-16T12:57:23.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f2dc9ffb640 1 -- 172.21.15.106:0/2738423237 <== osd.5 v2:172.21.15.171:6800/1858725458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2dd4068a90 con 0x7f2db8074c40 2024-04-16T12:57:23.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 -- 172.21.15.106:0/958957803 shutdown_connections 2024-04-16T12:57:23.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 -- 172.21.15.106:0/958957803 >> 172.21.15.106:0/958957803 conn(0x7f8080067dc0 msgr2=0x7f80801410f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f0d467fc640 1 -- 172.21.15.106:0/450320250 <== osd.6 v2:172.21.15.171:6816/2241406826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0d48005390 con 0x7f0d34074c40 2024-04-16T12:57:23.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 -- 172.21.15.106:0/958957803 shutdown_connections 2024-04-16T12:57:23.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f806b7fe640 1 -- 172.21.15.106:0/958957803 wait complete. 2024-04-16T12:57:23.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 --> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91b80b5890 con 0x7f91a4074c40 2024-04-16T12:57:23.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f2db8074c40 msgr2=0x7f2db8077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7f2db77fe640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f2db8074c40 0x7f2db8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.455+0000 7fd673ed9640 1 -- 172.21.15.106:0/423586737 --> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd6640ce410 con 0x7fd650074c40 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f919ffff640 1 -- 172.21.15.106:0/3086886776 <== osd.4 v2:172.21.15.171:6805/37616255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f91b80b5890 con 0x7f91a4074c40 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2db806c9c0 msgr2=0x7f2db806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2db806c9c0 0x7f2db806ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400d2c0 tx=0x7f2dc4008040 comp rx=0 tx=0).stop 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40b1630 msgr2=0x7f2dd40aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 --2- 172.21.15.106:0/2738423237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40b1630 0x7f2dd40aeee0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009890 tx=0x7f2dd00046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2dd9b71640 1 -- 172.21.15.106:0/2738423237 reap_dead start 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7f0d34074c40 msgr2=0x7f0d34077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f0d56f73640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7f0d34074c40 0x7f0d34077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7fd6627fc640 1 -- 172.21.15.106:0/423586737 <== osd.0 v2:172.21.15.106:6800/912307023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd6640ce410 con 0x7fd650074c40 2024-04-16T12:57:23.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 shutdown_connections 2024-04-16T12:57:23.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 >> 172.21.15.106:0/2738423237 conn(0x7f2dd406bfe0 msgr2=0x7f2dd40b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 shutdown_connections 2024-04-16T12:57:23.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f2db77fe640 1 -- 172.21.15.106:0/2738423237 wait complete. 2024-04-16T12:57:23.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7f91a4074c40 msgr2=0x7f91a4077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f91bc984640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7f91a4074c40 0x7f91a4077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0d3406c9c0 msgr2=0x7f0d3406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.456+0000 7f0d56f73640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0d3406c9c0 0x7f0d3406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d50000b60 tx=0x7f0d5006e040 comp rx=0 tx=0).stop 2024-04-16T12:57:23.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4800c360 msgr2=0x7f0d4803ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7fd64ffff640 1 -- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7fd650074c40 msgr2=0x7fd650077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7fd64ffff640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7fd650074c40 0x7fd650077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f91a406c9c0 msgr2=0x7f91a406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f0d56f73640 1 --2- 172.21.15.106:0/450320250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4800c360 0x7f0d4803ee40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c3c0 tx=0x7f0d4c00c880 comp rx=0 tx=0).stop 2024-04-16T12:57:23.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f0d56772640 1 -- 172.21.15.106:0/450320250 reap_dead start 2024-04-16T12:57:23.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f91bc984640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f91a406c9c0 0x7f91a406ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91ac007fd0 tx=0x7f91ac009040 comp rx=0 tx=0).stop 2024-04-16T12:57:23.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7fd64ffff640 1 -- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd65006c9c0 msgr2=0x7fd65006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7fd64ffff640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd65006c9c0 0x7fd65006ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd6640ce010 tx=0x7fd668008040 comp rx=0 tx=0).stop 2024-04-16T12:57:23.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 shutdown_connections 2024-04-16T12:57:23.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 >> 172.21.15.106:0/450320250 conn(0x7f0d4800b5d0 msgr2=0x7f0d480061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 shutdown_connections 2024-04-16T12:57:23.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f0d56f73640 1 -- 172.21.15.106:0/450320250 wait complete. 2024-04-16T12:57:23.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7fd64ffff640 1 -- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6640ca690 msgr2=0x7fd66415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91b80722a0 msgr2=0x7f91b8148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f91bc984640 1 --2- 172.21.15.106:0/3086886776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91b80722a0 0x7f91b8148d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91a80098f0 tx=0x7f91a80046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7fd64ffff640 1 --2- 172.21.15.106:0/423586737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6640ca690 0x7fd66415d340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0635c0 tx=0x7fd66c0657c0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f91b7fff640 1 -- 172.21.15.106:0/3086886776 reap_dead start 2024-04-16T12:57:23.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 --> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f23e0002d50 con 0x7f23dc074c40 2024-04-16T12:57:23.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 shutdown_connections 2024-04-16T12:57:23.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 >> 172.21.15.106:0/3086886776 conn(0x7f91b809d170 msgr2=0x7f91b80b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.457+0000 7fd672476640 1 -- 172.21.15.106:0/423586737 reap_dead start 2024-04-16T12:57:23.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.458+0000 7fd64ffff640 1 -- 172.21.15.106:0/423586737 shutdown_connections 2024-04-16T12:57:23.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.458+0000 7fd64ffff640 1 -- 172.21.15.106:0/423586737 >> 172.21.15.106:0/423586737 conn(0x7fd66403abf0 msgr2=0x7fd664005dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.458+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 shutdown_connections 2024-04-16T12:57:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.458+0000 7f91bc984640 1 -- 172.21.15.106:0/3086886776 wait complete. 2024-04-16T12:57:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.458+0000 7f23eaffd640 1 -- 172.21.15.106:0/447229473 <== osd.3 v2:172.21.15.106:6816/2118469111 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f23e0002d50 con 0x7f23dc074c40 2024-04-16T12:57:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.458+0000 7fd64ffff640 1 -- 172.21.15.106:0/423586737 shutdown_connections 2024-04-16T12:57:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.458+0000 7fd64ffff640 1 -- 172.21.15.106:0/423586737 wait complete. 2024-04-16T12:57:23.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7f23dc074c40 msgr2=0x7f23dc077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fb59e640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7f23dc074c40 0x7f23dc077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f23dc06c9c0 msgr2=0x7f23dc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fb59e640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f23dc06c9c0 0x7f23dc06ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009630 tx=0x7f23f003b040 comp rx=0 tx=0).stop 2024-04-16T12:57:23.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f40c4840 msgr2=0x7f23f4162f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fb59e640 1 --2- 172.21.15.106:0/447229473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f40c4840 0x7f23f4162f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23ec01c3a0 tx=0x7f23ec01c860 comp rx=0 tx=0).stop 2024-04-16T12:57:23.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fad9d640 1 -- 172.21.15.106:0/447229473 reap_dead start 2024-04-16T12:57:23.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.459+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 shutdown_connections 2024-04-16T12:57:23.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.460+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 >> 172.21.15.106:0/447229473 conn(0x7f23f40086e0 msgr2=0x7f23f40ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.460+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 shutdown_connections 2024-04-16T12:57:23.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.460+0000 7f23fb59e640 1 -- 172.21.15.106:0/447229473 wait complete. 2024-04-16T12:57:23.535 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:23.535 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T12:57:23.536 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:23.536 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T12:57:23.537 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:23.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T12:57:23.538 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2024-04-16T12:57:23.538 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T12:57:23.539 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:23.539 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T12:57:23.540 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:23.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T12:57:23.541 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2024-04-16T12:57:23.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T12:57:23.542 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2024-04-16T12:57:23.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T12:57:23.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.744+0000 7fa9f4996640 1 Processor -- start 2024-04-16T12:57:23.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.744+0000 7fa9f4996640 1 -- start start 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.745+0000 7fa9f4996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9f00b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.745+0000 7fa9f4996640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0143e10 con 0x7fa9f00b6b70 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.745+0000 7fa9f4996640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f009e520 con 0x7fa9f009e140 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.745+0000 7fa9f4996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f00b61a0 con 0x7fa9f006da70 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.746+0000 7fa9edd9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9f00b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.746+0000 7fa9edd9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9f00b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46056/0 (socket says 172.21.15.106:46056) 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.746+0000 7fa9edd9b640 1 -- 172.21.15.106:0/1687371853 learned_addr learned my addr 172.21.15.106:0/1687371853 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.746+0000 7fa9ee59c640 1 --1- 172.21.15.106:0/1687371853 >> v1:172.21.15.171:6789/0 conn(0x7fa9f009e140 0x7fa9f00b5310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33562/0 (socket says 172.21.15.106:33562) 2024-04-16T12:57:23.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073420658 0 0) 0x7fa9f0143e10 con 0x7fa9f00b6b70 2024-04-16T12:57:23.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9d8003db0 con 0x7fa9f00b6b70 2024-04-16T12:57:23.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.746+0000 7f19d80c8640 1 Processor -- start 2024-04-16T12:57:23.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7f19d80c8640 1 -- start start 2024-04-16T12:57:23.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1245301712 0 0) 0x7fa9d8003db0 con 0x7fa9f00b6b70 2024-04-16T12:57:23.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 msgr2=0x7fa9f00b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7fa9ed59a640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9f00b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 >> v1:172.21.15.171:6789/0 conn(0x7fa9f009e140 legacy=0x7fa9f00b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f00b5b00 con 0x7fa9f00b6b70 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9edd9b640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9f00b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fa9e4001670 con 0x7fa9f00b6b70 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 >> v1:172.21.15.106:6789/0 conn(0x7fa9f00b6b70 legacy=0x7fa9f013dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9ed59a640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9d8003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9ed59a640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9d8005090 0x7fa9d8005510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d80c8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f19d00963a0 0x7f19d00b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d80c8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19d006d180 0x7f19d009dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d80c8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d00b5490 con 0x7f19d006d5e0 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d80c8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f19d0158230 con 0x7f19d006d180 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d80c8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f19d00b5a20 con 0x7f19d00963a0 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7f7e35140640 1 Processor -- start 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.747+0000 7f7e35140640 1 -- start start 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e35140640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7e28036b90 0x7f7e280d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e35140640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e280383b0 0x7f7e280d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e35140640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280d49a0 0x7f7e280ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e35140640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f7e28036f70 con 0x7f7e280383b0 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e35140640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7e280d0ba0 con 0x7f7e28036b90 2024-04-16T12:57:23.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e35140640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e280d0e80 con 0x7f7e280d49a0 2024-04-16T12:57:23.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e2e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e280383b0 0x7f7e280d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e2e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e280383b0 0x7f7e280d4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42766/0 (socket says 172.21.15.106:42766) 2024-04-16T12:57:23.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e2e59c640 1 -- 172.21.15.106:0/1141789304 learned_addr learned my addr 172.21.15.106:0/1141789304 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f7e2f59e640 1 --2- 172.21.15.106:0/1141789304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280d49a0 0x7f7e280ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f7e2ed9d640 1 --2- 172.21.15.106:0/1141789304 >> v2:172.21.15.171:3300/0 conn(0x7f7e28036b90 0x7f7e280d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f0705014640 1 Processor -- start 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9edd9b640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9d8005090 0x7fa9d8005510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9ed59a640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8005c00 0x7fa9d8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7fa9ee59c640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9d8003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8004820 con 0x7fa9d8005090 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d80049d0 con 0x7fa9d8005c00 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9eed9d640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8005c00 0x7fa9d8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d8004bd0 con 0x7fa9f006da70 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9eed9d640 1 -- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 msgr2=0x7fa9d8003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f7e2f59e640 1 -- 172.21.15.106:0/1141789304 >> v2:172.21.15.171:3300/0 conn(0x7f7e28036b90 msgr2=0x7f7e280d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f7e2f59e640 1 --2- 172.21.15.106:0/1141789304 >> v2:172.21.15.171:3300/0 conn(0x7f7e28036b90 0x7f7e280d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f7e2f59e640 1 -- 172.21.15.106:0/1141789304 >> v2:172.21.15.106:3300/0 conn(0x7f7e280383b0 msgr2=0x7f7e280d4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f7e2f59e640 1 --2- 172.21.15.106:0/1141789304 >> v2:172.21.15.106:3300/0 conn(0x7f7e280383b0 0x7f7e280d4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f7e2f59e640 1 -- 172.21.15.106:0/1141789304 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e280d18e0 con 0x7f7e280d49a0 2024-04-16T12:57:23.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9eed9d640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9f006da70 0x7fa9d8003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9eed9d640 1 -- 172.21.15.106:0/1687371853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9d8005090 msgr2=0x7fa9d8005510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f0705014640 1 -- start start 2024-04-16T12:57:23.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f0705014640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07000b6570 0x7f070013deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f0705014640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f070013e3f0 0x7f0700071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f0705014640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0700070880 con 0x7f0700073270 2024-04-16T12:57:23.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f0705014640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f07000b6950 con 0x7f070013e3f0 2024-04-16T12:57:23.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f0705014640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0700070af0 con 0x7f07000b6570 2024-04-16T12:57:23.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7fa9eed9d640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9d8005090 0x7fa9d8005510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7fa9eed9d640 1 -- 172.21.15.106:0/1687371853 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d8003db0 con 0x7fa9d8005c00 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7fa9edd9b640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9d8005090 0x7fa9d8005510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d5e64640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f19d00963a0 0x7f19d00b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d6665640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f19d006d5e0 0x7f19d01586c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33574/0 (socket says 172.21.15.106:33574) 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d6665640 1 -- 172.21.15.106:0/887601988 learned_addr learned my addr 172.21.15.106:0/887601988 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.748+0000 7f19d5663640 1 --2- 172.21.15.106:0/887601988 >> v2:172.21.15.106:3300/0 conn(0x7f19d006d180 0x7f19d009dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f19d5e64640 1 -- 172.21.15.106:0/887601988 >> v2:172.21.15.106:3300/0 conn(0x7f19d006d180 msgr2=0x7f19d009dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f19d4e62640 1 -- 172.21.15.106:0/887601988 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464539190 0 0) 0x7f19d00b5490 con 0x7f19d006d5e0 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f19d5e64640 1 --2- 172.21.15.106:0/887601988 >> v2:172.21.15.106:3300/0 conn(0x7f19d006d180 0x7f19d009dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f19d5e64640 1 -- 172.21.15.106:0/887601988 >> v1:172.21.15.171:6789/0 conn(0x7f19d006d5e0 legacy=0x7f19d01586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.749+0000 7f19d5e64640 1 -- 172.21.15.106:0/887601988 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d006dae0 con 0x7f19d00963a0 2024-04-16T12:57:23.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f06fe59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f070013e3f0 0x7f0700071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7fa1cffff640 1 Processor -- start 2024-04-16T12:57:23.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f06fe59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f070013e3f0 0x7f0700071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42776/0 (socket says 172.21.15.106:42776) 2024-04-16T12:57:23.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f06fe59c640 1 -- 172.21.15.106:0/612380114 learned_addr learned my addr 172.21.15.106:0/612380114 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f19d5663640 1 --2- 172.21.15.106:0/887601988 >> v2:172.21.15.106:3300/0 conn(0x7f19d006d180 0x7f19d009dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:23.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7faff34af640 1 Processor -- start 2024-04-16T12:57:23.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7faff34af640 1 -- start start 2024-04-16T12:57:23.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7fa1cffff640 1 -- start start 2024-04-16T12:57:23.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa9eed9d640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8005c00 0x7fa9d8004030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4003cc0 tx=0x7fa9d80060c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c34c94c724482f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7f7e2f59e640 1 --2- 172.21.15.106:0/1141789304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280d49a0 0x7f7e280ca6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097d0 tx=0x7f7e2002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d719e8a1ef8b91f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4003910 con 0x7fa9d8005c00 2024-04-16T12:57:23.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e40062d0 con 0x7fa9d8005c00 2024-04-16T12:57:23.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa9ed59a640 1 -- 172.21.15.106:0/1687371853 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4008290 con 0x7fa9d8005c00 2024-04-16T12:57:23.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7f7e2dd9b640 1 -- 172.21.15.106:0/1141789304 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20035020 con 0x7f7e280d49a0 2024-04-16T12:57:23.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7f7e2dd9b640 1 -- 172.21.15.106:0/1141789304 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e20031810 con 0x7f7e280d49a0 2024-04-16T12:57:23.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7f7e2dd9b640 1 -- 172.21.15.106:0/1141789304 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20031be0 con 0x7f7e280d49a0 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d0143ff0 0x7fa1d00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa1cffff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa1d00affc0 0x7fa1d00b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa1cffff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d0070220 con 0x7fa1d0143c10 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa1cffff640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d0144750 con 0x7fa1d00affc0 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7fa1cffff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d0144a30 con 0x7fa1d0143ff0 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7faff34af640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec071780 0x7fafec145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7faff34af640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec070a20 con 0x7fafec0b2a70 2024-04-16T12:57:23.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7faff34af640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec0b2e50 con 0x7fafec146460 2024-04-16T12:57:23.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7f19d5e64640 1 --2- 172.21.15.106:0/887601988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d00963a0 0x7f19d00b4f50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19d009e790 tx=0x7f19c802bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5888e95c26ff2ba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa1cf7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa1d00affc0 0x7fa1d00b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa1ceffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa1d0143c10 0x7fa1d00b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59320/0 (socket says 172.21.15.106:59320) 2024-04-16T12:57:23.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa1ceffd640 1 -- 172.21.15.106:0/1807979974 learned_addr learned my addr 172.21.15.106:0/1807979974 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f06fe59c640 1 -- 172.21.15.106:0/612380114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07000b6570 msgr2=0x7f070013deb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:57:23.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa1cf7fe640 1 -- 172.21.15.106:0/1807979974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d0143ff0 msgr2=0x7fa1d00afa80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T12:57:23.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa1cf7fe640 1 --2- 172.21.15.106:0/1807979974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d0143ff0 0x7fa1d00afa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa1cf7fe640 1 -- 172.21.15.106:0/1807979974 >> v1:172.21.15.106:6789/0 conn(0x7fa1d0143c10 legacy=0x7fa1d00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa1cf7fe640 1 -- 172.21.15.106:0/1807979974 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d0144470 con 0x7fa1d00affc0 2024-04-16T12:57:23.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7f19d4e62640 1 -- 172.21.15.106:0/887601988 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8039070 con 0x7f19d00963a0 2024-04-16T12:57:23.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7f19d4e62640 1 -- 172.21.15.106:0/887601988 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c802ccb0 con 0x7f19d00963a0 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7f7e35140640 1 -- 172.21.15.106:0/1141789304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280d49a0 msgr2=0x7f7e280ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7f7e35140640 1 --2- 172.21.15.106:0/1141789304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280d49a0 0x7f7e280ca6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097d0 tx=0x7f7e2002b8b0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7faff34af640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fafec071cd0 con 0x7fafec071780 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7faff24ad640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fafec0b2a70 0x7fafec0b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59328/0 (socket says 172.21.15.106:59328) 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.751+0000 7faff24ad640 1 -- 172.21.15.106:0/1010082885 learned_addr learned my addr 172.21.15.106:0/1010082885 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7faff1cac640 1 --2- 172.21.15.106:0/1010082885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec071780 0x7fafec145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7faff14ab640 1 -- 172.21.15.106:0/1010082885 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 256614040 0 0) 0x7fafec070a20 con 0x7fafec0b2a70 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7faff14ab640 1 -- 172.21.15.106:0/1010082885 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd8003520 con 0x7fafec0b2a70 2024-04-16T12:57:23.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7faff1cac640 1 -- 172.21.15.106:0/1010082885 >> v1:172.21.15.171:6789/0 conn(0x7fafec146460 legacy=0x7fafec150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7faff1cac640 1 -- 172.21.15.106:0/1010082885 >> v1:172.21.15.106:6789/0 conn(0x7fafec0b2a70 legacy=0x7fafec0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7faff1cac640 1 -- 172.21.15.106:0/1010082885 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec071fb0 con 0x7fafec071780 2024-04-16T12:57:23.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f06fe59c640 1 --2- 172.21.15.106:0/612380114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07000b6570 0x7f070013deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f06fe59c640 1 -- 172.21.15.106:0/612380114 >> v1:172.21.15.106:6789/0 conn(0x7f0700073270 legacy=0x7f0700143ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:57:23.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.750+0000 7f06fe59c640 1 -- 172.21.15.106:0/612380114 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07000b3c30 con 0x7f070013e3f0 2024-04-16T12:57:23.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7f9cc9e15640 1 Processor -- start 2024-04-16T12:57:23.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7f9cc9e15640 1 -- start start 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa9f4996640 1 -- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8005c00 msgr2=0x7fa9d8004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa9f4996640 1 --2- 172.21.15.106:0/1687371853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8005c00 0x7fa9d8004030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4003cc0 tx=0x7fa9d80060c0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa9eed9d640 1 -- 172.21.15.106:0/1687371853 reap_dead start 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa9f4996640 1 -- 172.21.15.106:0/1687371853 shutdown_connections 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa9f4996640 1 -- 172.21.15.106:0/1687371853 >> 172.21.15.106:0/1687371853 conn(0x7fa9f009c5e0 msgr2=0x7fa9f009c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa9f4996640 1 -- 172.21.15.106:0/1687371853 shutdown_connections 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.752+0000 7fa9f4996640 1 -- 172.21.15.106:0/1687371853 wait complete. 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc9e15640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9cc406fa20 0x7f9cc414c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc9e15640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc4150310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc9e15640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc406f6f0 con 0x7f9cc406f310 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc9e15640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc414f8c0 con 0x7f9cc406fa20 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc9e15640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc414fb10 con 0x7f9cc409cc90 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d4e62640 1 -- 172.21.15.106:0/887601988 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8039070 con 0x7f19d00963a0 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d80c8640 1 -- 172.21.15.106:0/887601988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d00963a0 msgr2=0x7f19d00b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d80c8640 1 --2- 172.21.15.106:0/887601988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d00963a0 0x7f19d00b4f50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19d009e790 tx=0x7f19c802bf00 comp rx=0 tx=0).stop 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc3fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9cc406fa20 0x7f9cc414c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc3fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9cc406fa20 0x7f9cc414c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42782/0 (socket says 172.21.15.106:42782) 2024-04-16T12:57:23.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc3fff640 1 -- 172.21.15.106:0/265403953 learned_addr learned my addr 172.21.15.106:0/265403953 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d80c8640 1 -- 172.21.15.106:0/887601988 shutdown_connections 2024-04-16T12:57:23.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d80c8640 1 --2- 172.21.15.106:0/887601988 >> v2:172.21.15.106:3300/0 conn(0x7f19d006d180 0x7f19d009dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d80c8640 1 --2- 172.21.15.106:0/887601988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d00963a0 0x7f19d00b4f50 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19d009e790 tx=0x7f19c802bf00 comp rx=0 tx=0).stop 2024-04-16T12:57:23.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d80c8640 1 -- 172.21.15.106:0/887601988 >> 172.21.15.106:0/887601988 conn(0x7f19d009c5e0 msgr2=0x7f19d009c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f7e35140640 1 -- 172.21.15.106:0/1141789304 shutdown_connections 2024-04-16T12:57:23.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f7e35140640 1 --2- 172.21.15.106:0/1141789304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280d49a0 0x7f7e280ca6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f7e35140640 1 --2- 172.21.15.106:0/1141789304 >> v2:172.21.15.106:3300/0 conn(0x7f7e280383b0 0x7f7e280d4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f7e35140640 1 --2- 172.21.15.106:0/1141789304 >> v2:172.21.15.171:3300/0 conn(0x7f7e28036b90 0x7f7e280d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f7e35140640 1 -- 172.21.15.106:0/1141789304 >> 172.21.15.106:0/1141789304 conn(0x7f7e2803a8d0 msgr2=0x7f7e2803ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc9614640 1 --2- 172.21.15.106:0/265403953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc4150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f06fe59c640 1 --2- 172.21.15.106:0/612380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070013e3f0 0x7f0700071220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009e30 tx=0x7f06f802d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0a801470975711 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc3fff640 1 -- 172.21.15.106:0/265403953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 msgr2=0x7f9cc4150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:23.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc3fff640 1 --2- 172.21.15.106:0/265403953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc4150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc3fff640 1 -- 172.21.15.106:0/265403953 >> v1:172.21.15.106:6789/0 conn(0x7f9cc406f310 legacy=0x7f9cc406e350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:57:23.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f9cc3fff640 1 -- 172.21.15.106:0/265403953 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc414fdf0 con 0x7f9cc406fa20 2024-04-16T12:57:23.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f7e35140640 1 -- 172.21.15.106:0/1141789304 shutdown_connections 2024-04-16T12:57:23.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.753+0000 7f19d80c8640 1 -- 172.21.15.106:0/887601988 shutdown_connections 2024-04-16T12:57:23.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f19d80c8640 1 -- 172.21.15.106:0/887601988 wait complete. 2024-04-16T12:57:23.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f7e35140640 1 -- 172.21.15.106:0/1141789304 wait complete. 2024-04-16T12:57:23.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7fa1cf7fe640 1 --2- 172.21.15.106:0/1807979974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d00affc0 0x7fa1d00b0b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40097a0 tx=0x7fa1c402b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da1dc94c4ac1d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7faff1cac640 1 --2- 172.21.15.106:0/1010082885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec071780 0x7fafec145f20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009750 tx=0x7fafdc02b600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce1c9fb63a38842 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f06fdd9b640 1 -- 172.21.15.106:0/612380114 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8039070 con 0x7f070013e3f0 2024-04-16T12:57:23.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f06fdd9b640 1 -- 172.21.15.106:0/612380114 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8034400 con 0x7f070013e3f0 2024-04-16T12:57:23.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f06fdd9b640 1 -- 172.21.15.106:0/612380114 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8039070 con 0x7f070013e3f0 2024-04-16T12:57:23.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7fa1cdffb640 1 -- 172.21.15.106:0/1807979974 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4037070 con 0x7fa1d00affc0 2024-04-16T12:57:23.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7fa9f4996640 1 Processor -- start 2024-04-16T12:57:23.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7fa1cdffb640 1 -- 172.21.15.106:0/1807979974 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c4030710 con 0x7fa1d00affc0 2024-04-16T12:57:23.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7faff14ab640 1 -- 172.21.15.106:0/1010082885 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc037070 con 0x7fafec071780 2024-04-16T12:57:23.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7fa1cdffb640 1 -- 172.21.15.106:0/1807979974 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4037070 con 0x7fa1d00affc0 2024-04-16T12:57:23.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7faff14ab640 1 -- 172.21.15.106:0/1010082885 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc030710 con 0x7fafec071780 2024-04-16T12:57:23.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7faff14ab640 1 -- 172.21.15.106:0/1010082885 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc037070 con 0x7fafec071780 2024-04-16T12:57:23.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f6d00c0d640 1 Processor -- start 2024-04-16T12:57:23.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f6d00c0d640 1 -- start start 2024-04-16T12:57:23.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7f9cc3fff640 1 --2- 172.21.15.106:0/265403953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406fa20 0x7f9cc414c350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009870 tx=0x7f9cbc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93957f60299ae01 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f0705014640 1 -- 172.21.15.106:0/612380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070013e3f0 msgr2=0x7f0700071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f0705014640 1 --2- 172.21.15.106:0/612380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070013e3f0 0x7f0700071220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009e30 tx=0x7f06f802d660 comp rx=0 tx=0).stop 2024-04-16T12:57:23.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f9cc37fe640 1 -- 172.21.15.106:0/265403953 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc038070 con 0x7f9cc406fa20 2024-04-16T12:57:23.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f9cc37fe640 1 -- 172.21.15.106:0/265403953 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc031740 con 0x7f9cc406fa20 2024-04-16T12:57:23.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f9cc37fe640 1 -- 172.21.15.106:0/265403953 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc02f050 con 0x7f9cc406fa20 2024-04-16T12:57:23.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f19d80c8640 1 Processor -- start 2024-04-16T12:57:23.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f19d80c8640 1 -- start start 2024-04-16T12:57:23.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa1cffff640 1 -- 172.21.15.106:0/1807979974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d00affc0 msgr2=0x7fa1d00b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa1cffff640 1 --2- 172.21.15.106:0/1807979974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d00affc0 0x7fa1d00b0b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40097a0 tx=0x7fa1c402b730 comp rx=0 tx=0).stop 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.754+0000 7fa9f4996640 1 -- start start 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa9f4996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9d8005c00 0x7fa9f01451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa9f4996640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f0145d10 0x7fa9f00b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa9f4996640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9f0146ae0 0x7fa9f00b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa9f4996640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f009d250 con 0x7fa9f0145d10 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa9f4996640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f009d0d0 con 0x7fa9f0146ae0 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa9f4996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f013e2e0 con 0x7fa9d8005c00 2024-04-16T12:57:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa1cffff640 1 -- 172.21.15.106:0/1807979974 shutdown_connections 2024-04-16T12:57:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa1cffff640 1 --2- 172.21.15.106:0/1807979974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d00affc0 0x7fa1d00b0b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa1cffff640 1 --2- 172.21.15.106:0/1807979974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d0143ff0 0x7fa1d00afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7fa1cffff640 1 -- 172.21.15.106:0/1807979974 >> 172.21.15.106:0/1807979974 conn(0x7fa1d006bfe0 msgr2=0x7fa1d00b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f0705014640 1 -- 172.21.15.106:0/612380114 shutdown_connections 2024-04-16T12:57:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f7e35140640 1 Processor -- start 2024-04-16T12:57:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f7e35140640 1 -- start start 2024-04-16T12:57:23.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f0705014640 1 --2- 172.21.15.106:0/612380114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070013e3f0 0x7f0700071220 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f0705014640 1 --2- 172.21.15.106:0/612380114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07000b6570 0x7f070013deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7fa9edd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f0145d10 0x7fa9f00b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.755+0000 7f0705014640 1 -- 172.21.15.106:0/612380114 >> 172.21.15.106:0/612380114 conn(0x7f070006b9b0 msgr2=0x7f070006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f0705014640 1 -- 172.21.15.106:0/612380114 shutdown_connections 2024-04-16T12:57:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7fa9edd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f0145d10 0x7fa9f00b9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42792/0 (socket says 172.21.15.106:42792) 2024-04-16T12:57:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7fa9edd9b640 1 -- 172.21.15.106:0/2823544604 learned_addr learned my addr 172.21.15.106:0/2823544604 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f0705014640 1 -- 172.21.15.106:0/612380114 wait complete. 2024-04-16T12:57:23.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f6d00c0d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6cfc06e4c0 0x7f6cfc09ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f6d00c0d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc0af7e0 con 0x7f6cfc09b240 2024-04-16T12:57:23.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f9cc9e15640 1 -- 172.21.15.106:0/265403953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406fa20 msgr2=0x7f9cc414c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/265403953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406fa20 0x7f9cc414c350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009870 tx=0x7f9cbc02b7e0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f6d00c0d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc06e8a0 con 0x7f6cfc0b5660 2024-04-16T12:57:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7faff34af640 1 -- 172.21.15.106:0/1010082885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec071780 msgr2=0x7fafec145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f6d00c0d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc09b680 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7faff34af640 1 --2- 172.21.15.106:0/1010082885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec071780 0x7fafec145f20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009750 tx=0x7fafdc02b600 comp rx=0 tx=0).stop 2024-04-16T12:57:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f6cf9d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6cfc09b240 0x7f6cfc0b4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59350/0 (socket says 172.21.15.106:59350) 2024-04-16T12:57:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f7e35140640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e28036b90 0x7f7e280bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f6cf9d9b640 1 -- 172.21.15.106:0/3561636590 learned_addr learned my addr 172.21.15.106:0/3561636590 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7faff34af640 1 -- 172.21.15.106:0/1010082885 shutdown_connections 2024-04-16T12:57:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7faff34af640 1 --2- 172.21.15.106:0/1010082885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec071780 0x7fafec145f20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7faff34af640 1 -- 172.21.15.106:0/1010082885 >> 172.21.15.106:0/1010082885 conn(0x7fafec06c2c0 msgr2=0x7fafec0b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d80c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d006d180 0x7f19d0095860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d80c8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19d006d5e0 0x7f19d0097d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d80c8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d01fe5c0 0x7f19d0159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d80c8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0158dd0 con 0x7f19d006d5e0 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d80c8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f19d009e3d0 con 0x7f19d01fe5c0 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d80c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f19d0158f50 con 0x7f19d006d180 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d6665640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d01fe5c0 0x7f19d0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d5e64640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d006d180 0x7f19d0095860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d5e64640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d006d180 0x7f19d0095860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46124/0 (socket says 172.21.15.106:46124) 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d5e64640 1 -- 172.21.15.106:0/3318329332 learned_addr learned my addr 172.21.15.106:0/3318329332 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f19d5663640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19d006d5e0 0x7f19d0097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7faff34af640 1 -- 172.21.15.106:0/1010082885 shutdown_connections 2024-04-16T12:57:23.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f7e35140640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280383b0 0x7f7e280d6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f7e35140640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e280d49a0 0x7f7e280bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7fa9eed9d640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9f0146ae0 0x7fa9f00b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7fa9ee59c640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9d8005c00 0x7fa9f01451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e28036b90 0x7f7e280bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e35140640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7e280cad80 con 0x7f7e28036b90 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e35140640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e280cac00 con 0x7f7e280d49a0 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e35140640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e280caf00 con 0x7f7e280383b0 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e28036b90 0x7f7e280bf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42804/0 (socket says 172.21.15.106:42804) 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 -- 172.21.15.106:0/1371223048 learned_addr learned my addr 172.21.15.106:0/1371223048 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2e59c640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280383b0 0x7f7e280d6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2f59e640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e280d49a0 0x7f7e280bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9edd9b640 1 -- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9d8005c00 msgr2=0x7fa9f01451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9edd9b640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9d8005c00 0x7fa9f01451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9edd9b640 1 -- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9f0146ae0 msgr2=0x7fa9f00b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9edd9b640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9f0146ae0 0x7fa9f00b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f19d5663640 1 -- 172.21.15.106:0/3318329332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d006d180 msgr2=0x7f19d0095860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f19d5663640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d006d180 0x7f19d0095860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f19d5663640 1 -- 172.21.15.106:0/3318329332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d01fe5c0 msgr2=0x7f19d0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f19d5663640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d01fe5c0 0x7f19d0159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9edd9b640 1 -- 172.21.15.106:0/2823544604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f00b31f0 con 0x7fa9f0145d10 2024-04-16T12:57:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f19d5663640 1 -- 172.21.15.106:0/3318329332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d0155020 con 0x7f19d006d5e0 2024-04-16T12:57:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f19d6665640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d01fe5c0 0x7f19d0159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9edd9b640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f0145d10 0x7fa9f00b9c10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0011ca0 tx=0x7fa9e000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7faff34af640 1 -- 172.21.15.106:0/1010082885 wait complete. 2024-04-16T12:57:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 -- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280383b0 msgr2=0x7f7e280d6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280383b0 0x7f7e280d6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 -- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e280d49a0 msgr2=0x7f7e280bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e280d49a0 0x7f7e280bd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f7e2ed9d640 1 -- 172.21.15.106:0/1371223048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e280340e0 con 0x7f7e28036b90 2024-04-16T12:57:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f9cc9e15640 1 -- 172.21.15.106:0/265403953 shutdown_connections 2024-04-16T12:57:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/265403953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc4150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/265403953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406fa20 0x7f9cc414c350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f9cc9e15640 1 -- 172.21.15.106:0/265403953 >> 172.21.15.106:0/265403953 conn(0x7f9cc409d170 msgr2=0x7f9cc409d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9deffd640 1 -- 172.21.15.106:0/2823544604 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000fd20 con 0x7fa9f0145d10 2024-04-16T12:57:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7f6cfa59c640 1 --2- 172.21.15.106:0/3561636590 >> v2:172.21.15.171:3300/0 conn(0x7f6cfc06e4c0 0x7f6cfc09ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f6cfa59c640 1 -- 172.21.15.106:0/3561636590 >> v1:172.21.15.171:6789/0 conn(0x7f6cfc0b5660 legacy=0x7f6cfc06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f6cf959a640 1 -- 172.21.15.106:0/3561636590 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292280648 0 0) 0x7f6cfc0af7e0 con 0x7f6cfc09b240 2024-04-16T12:57:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f6cfa59c640 1 -- 172.21.15.106:0/3561636590 >> v1:172.21.15.106:6789/0 conn(0x7f6cfc09b240 legacy=0x7f6cfc0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7f6cfa59c640 1 -- 172.21.15.106:0/3561636590 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc0b0190 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.756+0000 7fa1cffff640 1 -- 172.21.15.106:0/1807979974 shutdown_connections 2024-04-16T12:57:23.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7f19d5663640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19d006d5e0 0x7f19d0097d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00e900 tx=0x7f19cc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7f7e2ed9d640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e28036b90 0x7f7e280bf120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400d5f0 tx=0x7f7e2400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.757+0000 7fa9f4996640 1 -- 172.21.15.106:0/2823544604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f0146370 con 0x7fa9f0145d10 2024-04-16T12:57:23.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7fa9deffd640 1 -- 172.21.15.106:0/2823544604 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e0014440 con 0x7fa9f0145d10 2024-04-16T12:57:23.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7fa9deffd640 1 -- 172.21.15.106:0/2823544604 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00147f0 con 0x7fa9f0145d10 2024-04-16T12:57:23.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7fa9f4996640 1 -- 172.21.15.106:0/2823544604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f00b37c0 con 0x7fa9f0145d10 2024-04-16T12:57:23.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7fa1cffff640 1 -- 172.21.15.106:0/1807979974 wait complete. 2024-04-16T12:57:23.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7f9cc9e15640 1 -- 172.21.15.106:0/265403953 shutdown_connections 2024-04-16T12:57:23.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7faff34af640 1 Processor -- start 2024-04-16T12:57:23.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7f0705014640 1 Processor -- start 2024-04-16T12:57:23.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7f9cc9e15640 1 -- 172.21.15.106:0/265403953 wait complete. 2024-04-16T12:57:23.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7faff34af640 1 -- start start 2024-04-16T12:57:23.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7fa9f4996640 1 -- 172.21.15.106:0/2823544604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f0068a90 con 0x7fa9f0145d10 2024-04-16T12:57:23.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff34af640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec0b2a70 0x7fafec152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff34af640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafec146460 0x7fafec13ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff34af640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafec13bf90 0x7fafec145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7fa1cffff640 1 Processor -- start 2024-04-16T12:57:23.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f7e177fe640 1 -- 172.21.15.106:0/1371223048 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e240125f0 con 0x7f7e28036b90 2024-04-16T12:57:23.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff34af640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fafec073e20 con 0x7fafec146460 2024-04-16T12:57:23.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.758+0000 7f0705014640 1 -- start start 2024-04-16T12:57:23.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f0705014640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0700073270 0x7f07000b9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f0705014640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07000b6570 0x7f0700133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f0705014640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f070013e3f0 0x7f0700133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff34af640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fafec073ca0 con 0x7fafec13bf90 2024-04-16T12:57:23.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff34af640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fafec1490c0 con 0x7fafec0b2a70 2024-04-16T12:57:23.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f0705014640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f07000b5a30 con 0x7f0700073270 2024-04-16T12:57:23.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f0705014640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f07000b58b0 con 0x7f07000b6570 2024-04-16T12:57:23.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f0705014640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0700068a90 con 0x7f070013e3f0 2024-04-16T12:57:23.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f6cfa59c640 1 --2- 172.21.15.106:0/3561636590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc09ad00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097a0 tx=0x7f6cec02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3519af11805806 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7fa1cffff640 1 -- start start 2024-04-16T12:57:23.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff2cae640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafec13bf90 0x7fafec145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff2cae640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafec13bf90 0x7fafec145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53766/0 (socket says 172.21.15.106:53766) 2024-04-16T12:57:23.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7faff2cae640 1 -- 172.21.15.106:0/3070974347 learned_addr learned my addr 172.21.15.106:0/3070974347 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f06ff59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f070013e3f0 0x7f0700133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06ff59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f070013e3f0 0x7f0700133f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46148/0 (socket says 172.21.15.106:46148) 2024-04-16T12:57:23.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06ff59e640 1 -- 172.21.15.106:0/2314955628 learned_addr learned my addr 172.21.15.106:0/2314955628 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06fe59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07000b6570 0x7f0700133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff24ad640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec0b2a70 0x7fafec152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f6cf959a640 1 -- 172.21.15.106:0/3561636590 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0315a0 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff1cac640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafec146460 0x7fafec13ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7fa9deffd640 1 -- 172.21.15.106:0/2823544604 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9e0012040 con 0x7fa9f0145d10 2024-04-16T12:57:23.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f6cf959a640 1 -- 172.21.15.106:0/3561636590 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec037070 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff2cae640 1 -- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec0b2a70 msgr2=0x7fafec152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff2cae640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec0b2a70 0x7fafec152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06fe59c640 1 -- 172.21.15.106:0/2314955628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f070013e3f0 msgr2=0x7f0700133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06fe59c640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f070013e3f0 0x7f0700133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06fe59c640 1 -- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0700073270 msgr2=0x7f07000b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06fe59c640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0700073270 0x7f07000b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06fe59c640 1 -- 172.21.15.106:0/2314955628 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0700143370 con 0x7f07000b6570 2024-04-16T12:57:23.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d00affc0 0x7fa1d01521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1d0143c10 0x7fa1d01e1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff2cae640 1 -- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafec146460 msgr2=0x7fafec13ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff2cae640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafec146460 0x7fafec13ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff2cae640 1 -- 172.21.15.106:0/3070974347 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0b1d00 con 0x7fafec13bf90 2024-04-16T12:57:23.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff1cac640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafec146460 0x7fafec13ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d0143ff0 0x7fa1d01e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7faff2cae640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafec13bf90 0x7fafec145330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fafe400caf0 tx=0x7fafe4002070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7fa1cffff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d006c570 con 0x7fa1d0143c10 2024-04-16T12:57:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7fa1cffff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d006c3f0 con 0x7fa1d0143ff0 2024-04-16T12:57:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7fa1cffff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d00b1050 con 0x7fa1d00affc0 2024-04-16T12:57:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f06fe59c640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07000b6570 0x7f0700133a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06f8033000 tx=0x7f06f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1ceffd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d00affc0 0x7fa1d01521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1ceffd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d00affc0 0x7fa1d01521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46162/0 (socket says 172.21.15.106:46162) 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1ceffd640 1 -- 172.21.15.106:0/2542762218 learned_addr learned my addr 172.21.15.106:0/2542762218 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1cf7fe640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d0143ff0 0x7fa1d01e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1ce7fc640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1d0143c10 0x7fa1d01e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f7e35140640 1 -- 172.21.15.106:0/1371223048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e280dac50 con 0x7f7e28036b90 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f7e35140640 1 -- 172.21.15.106:0/1371223048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e280da4e0 con 0x7f7e28036b90 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f7e177fe640 1 -- 172.21.15.106:0/1371223048 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24019070 con 0x7f7e28036b90 2024-04-16T12:57:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f7e177fe640 1 -- 172.21.15.106:0/1371223048 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e240129b0 con 0x7f7e28036b90 2024-04-16T12:57:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3561636590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 msgr2=0x7f6cfc09ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3561636590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc09ad00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097a0 tx=0x7f6cec02b840 comp rx=0 tx=0).stop 2024-04-16T12:57:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f06e77fe640 1 -- 172.21.15.106:0/2314955628 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8044020 con 0x7f07000b6570 2024-04-16T12:57:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f06e77fe640 1 -- 172.21.15.106:0/2314955628 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f80077a0 con 0x7f07000b6570 2024-04-16T12:57:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f06e77fe640 1 -- 172.21.15.106:0/2314955628 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8039070 con 0x7f07000b6570 2024-04-16T12:57:23.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fafe2ffd640 1 -- 172.21.15.106:0/3070974347 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4003da0 con 0x7fafec13bf90 2024-04-16T12:57:23.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fafe2ffd640 1 -- 172.21.15.106:0/3070974347 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe400a700 con 0x7fafec13bf90 2024-04-16T12:57:23.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fafe2ffd640 1 -- 172.21.15.106:0/3070974347 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe400aaf0 con 0x7fafec13bf90 2024-04-16T12:57:23.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7faff34af640 1 -- 172.21.15.106:0/3070974347 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafec137130 con 0x7fafec13bf90 2024-04-16T12:57:23.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0700138ef0 con 0x7f07000b6570 2024-04-16T12:57:23.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7faff34af640 1 -- 172.21.15.106:0/3070974347 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafec0b2250 con 0x7fafec13bf90 2024-04-16T12:57:23.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07001394b0 con 0x7f07000b6570 2024-04-16T12:57:23.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3561636590 shutdown_connections 2024-04-16T12:57:23.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3561636590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc09ad00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3561636590 >> 172.21.15.106:0/3561636590 conn(0x7f6cfc0ba550 msgr2=0x7f6cfc0ba930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:23.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa9deffd640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa9d006c8f0 0x7fa9d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3561636590 shutdown_connections 2024-04-16T12:57:23.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f19c27fc640 1 -- 172.21.15.106:0/3318329332 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc017070 con 0x7f19d006d5e0 2024-04-16T12:57:23.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa9deffd640 1 -- 172.21.15.106:0/2823544604 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa9e008c370 con 0x7fa9f0145d10 2024-04-16T12:57:23.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7fa9ee59c640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa9d006c8f0 0x7fa9d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1cf7fe640 1 -- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d00affc0 msgr2=0x7fa1d01521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1cf7fe640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d00affc0 0x7fa1d01521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1cf7fe640 1 -- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1d0143c10 msgr2=0x7fa1d01e1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.763+0000 7f19d80c8640 1 -- 172.21.15.106:0/3318329332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d0097570 con 0x7f19d006d5e0 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f9cc9e15640 1 Processor -- start 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.759+0000 7f9cc9e15640 1 -- start start 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.760+0000 7f9cc9e15640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406f310 0x7f9cc4140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc9e15640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc40b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc8e13640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406f310 0x7f9cc4140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc8e13640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406f310 0x7f9cc4140160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42844/0 (socket says 172.21.15.106:42844) 2024-04-16T12:57:23.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc3fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc40b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc8e13640 1 -- 172.21.15.106:0/1803727233 learned_addr learned my addr 172.21.15.106:0/1803727233 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cc41e2930 0x7f9cc41409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc4070640 con 0x7f9cc406f310 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc40704c0 con 0x7f9cc41e2930 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc4156bf0 con 0x7f9cc409cc90 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f9cc8e13640 1 -- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 msgr2=0x7f9cc40b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f9cc8e13640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc40b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f9cc8e13640 1 -- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cc41e2930 msgr2=0x7f9cc41409a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f9cc8e13640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cc41e2930 0x7f9cc41409a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f9cc8e13640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc41e1e90 con 0x7f9cc406f310 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f9cc8e13640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406f310 0x7f9cc4140160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9cb401d7a0 tx=0x7f9cb401dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.763+0000 7f9cc3fff640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc40b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:23.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3561636590 wait complete. 2024-04-16T12:57:23.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.763+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc8005290 con 0x7fafec13bf90 2024-04-16T12:57:23.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.763+0000 7f19d80c8640 1 -- 172.21.15.106:0/3318329332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d009c250 con 0x7f19d006d5e0 2024-04-16T12:57:23.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1cf7fe640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1d0143c10 0x7fa1d01e1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.763+0000 7f19c27fc640 1 -- 172.21.15.106:0/3318329332 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc00ca00 con 0x7f19d006d5e0 2024-04-16T12:57:23.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.763+0000 7f19c27fc640 1 -- 172.21.15.106:0/3318329332 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00cdf0 con 0x7f19d006d5e0 2024-04-16T12:57:23.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.761+0000 7fa1cf7fe640 1 -- 172.21.15.106:0/2542762218 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d0145320 con 0x7fa1d0143ff0 2024-04-16T12:57:23.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7fa1cf7fe640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d0143ff0 0x7fa1d01e1ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00b9fd0 tx=0x7fa1c40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.763+0000 7fa9ee59c640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa9d006c8f0 0x7fa9d006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8007fd0 tx=0x7fa9e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7f6d00c0d640 1 Processor -- start 2024-04-16T12:57:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7f6d00c0d640 1 -- start start 2024-04-16T12:57:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7f06e77fe640 1 -- 172.21.15.106:0/2314955628 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f06f8047020 con 0x7f07000b6570 2024-04-16T12:57:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.762+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e08005290 con 0x7f7e28036b90 2024-04-16T12:57:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7fafe2ffd640 1 -- 172.21.15.106:0/3070974347 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafe400ac90 con 0x7fafec13bf90 2024-04-16T12:57:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac005290 con 0x7f19d006d5e0 2024-04-16T12:57:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e0005290 con 0x7f07000b6570 2024-04-16T12:57:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.764+0000 7f06e77fe640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f06ec06c9c0 0x7f06ec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7fafe2ffd640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fafd006c970 0x7fafd006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6d00c0d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc1e4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6d00c0d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cfc09b240 0x7f6cfc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f06e77fe640 1 -- 172.21.15.106:0/2314955628 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06f80ae570 con 0x7f07000b6570 2024-04-16T12:57:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f06fed9d640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f06ec06c9c0 0x7f06ec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc1e4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc1e4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53790/0 (socket says 172.21.15.106:53790) 2024-04-16T12:57:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7fafe2ffd640 1 -- 172.21.15.106:0/3070974347 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fafe408c600 con 0x7fafec13bf90 2024-04-16T12:57:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7faff24ad640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fafd006c970 0x7fafd006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6d00c0d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6cfc0b5660 0x7f6cfc0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6d00c0d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc09cfa0 con 0x7f6cfc09b240 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6d00c0d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc09ce20 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6d00c0d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc0b6cd0 con 0x7f6cfc0b5660 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cf9d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cfc09b240 0x7f6cfc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cf9d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cfc09b240 0x7f6cfc072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42846/0 (socket says 172.21.15.106:42846) 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 -- 172.21.15.106:0/3901786490 learned_addr learned my addr 172.21.15.106:0/3901786490 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfad9d640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6cfc0b5660 0x7f6cfc0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7faff24ad640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fafd006c970 0x7fafd006ee30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fafe80011e0 tx=0x7fafe8007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 -- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6cfc0b5660 msgr2=0x7f6cfc0b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6cfc0b5660 0x7f6cfc0b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 -- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cfc09b240 msgr2=0x7f6cfc072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:23.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cfc09b240 0x7f6cfc072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:23.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cfa59c640 1 -- 172.21.15.106:0/3901786490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc14a3e0 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.765+0000 7f6cf9d9b640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cfc09b240 0x7f6cfc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:23.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.766+0000 7f06fed9d640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f06ec06c9c0 0x7f06ec06ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0700139c20 tx=0x7f06f4006c40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.766+0000 7f6cfa59c640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc1e4ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cec034040 tx=0x7f6cec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7fa9deffd640 1 -- 172.21.15.106:0/2823544604 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa9e0019030 con 0x7fa9f0145d10 2024-04-16T12:57:23.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7f9cc17fa640 1 -- 172.21.15.106:0/1803727233 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4028070 con 0x7f9cc406f310 2024-04-16T12:57:23.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc4141400 con 0x7f9cc406f310 2024-04-16T12:57:23.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc41e2130 con 0x7f9cc406f310 2024-04-16T12:57:23.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7f6ceaffd640 1 -- 172.21.15.106:0/3901786490 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec049070 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc0b3740 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7fa1b77fe640 1 -- 172.21.15.106:0/2542762218 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4042020 con 0x7fa1d0143ff0 2024-04-16T12:57:23.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7fa1cffff640 1 -- 172.21.15.106:0/2542762218 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d0150e30 con 0x7fa1d0143ff0 2024-04-16T12:57:23.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7fa1cffff640 1 -- 172.21.15.106:0/2542762218 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d0144d00 con 0x7fa1d0143ff0 2024-04-16T12:57:23.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.768+0000 7fafe2ffd640 1 -- 172.21.15.106:0/3070974347 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fafe405aaa0 con 0x7fafec13bf90 2024-04-16T12:57:23.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.769+0000 7f9cc17fa640 1 -- 172.21.15.106:0/1803727233 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb4003d80 con 0x7f9cc406f310 2024-04-16T12:57:23.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.769+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc0b4060 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.770+0000 7f9cc17fa640 1 -- 172.21.15.106:0/1803727233 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400b060 con 0x7f9cc406f310 2024-04-16T12:57:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.770+0000 7fa1cffff640 1 -- 172.21.15.106:0/2542762218 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d0068a90 con 0x7fa1d0143ff0 2024-04-16T12:57:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.771+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc1e5a60 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.771+0000 7f9cc17fa640 1 -- 172.21.15.106:0/1803727233 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cb4005330 con 0x7f9cc406f310 2024-04-16T12:57:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.771+0000 7f19c27fc640 1 -- 172.21.15.106:0/3318329332 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19cc01a070 con 0x7f19d006d5e0 2024-04-16T12:57:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.771+0000 7f7e177fe640 1 -- 172.21.15.106:0/1371223048 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e24012b50 con 0x7f7e28036b90 2024-04-16T12:57:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.771+0000 7f9cc17fa640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9ca406c8f0 0x7f9ca406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.771+0000 7f19c27fc640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f19b406c9c0 0x7f19b406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.771+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca8005290 con 0x7f9cc406f310 2024-04-16T12:57:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.772+0000 7f19c27fc640 1 -- 172.21.15.106:0/3318329332 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19cc08c0d0 con 0x7f19d006d5e0 2024-04-16T12:57:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.772+0000 7f9cc3fff640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9ca406c8f0 0x7f9ca406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.772+0000 7f19d5e64640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f19b406c9c0 0x7f19b406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.772+0000 7f7e177fe640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7e1c06c9c0 0x7f7e1c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.772+0000 7f7e177fe640 1 -- 172.21.15.106:0/1371223048 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2408ca10 con 0x7f7e28036b90 2024-04-16T12:57:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.772+0000 7f19d5e64640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f19b406c9c0 0x7f19b406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19c802bf40 tx=0x7f19c8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.772+0000 7f7e2e59c640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7e1c06c9c0 0x7f7e1c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.773+0000 7f7e2e59c640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7e1c06c9c0 0x7f7e1c06ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e3006afa0 tx=0x7f7e3006e040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.773+0000 7f9cc3fff640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9ca406c8f0 0x7f9ca406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc035000 tx=0x7f9cbc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.773+0000 7fa1b77fe640 1 -- 172.21.15.106:0/2542762218 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c4030710 con 0x7fa1d0143ff0 2024-04-16T12:57:23.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.773+0000 7f6ceaffd640 1 -- 172.21.15.106:0/3901786490 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec037030 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.773+0000 7f6ceaffd640 1 -- 172.21.15.106:0/3901786490 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec031740 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.773+0000 7f06e77fe640 1 -- 172.21.15.106:0/2314955628 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f06f807cad0 con 0x7f07000b6570 2024-04-16T12:57:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.773+0000 7fa1b77fe640 1 -- 172.21.15.106:0/2542762218 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4037040 con 0x7fa1d0143ff0 2024-04-16T12:57:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.774+0000 7fa1b77fe640 1 -- 172.21.15.106:0/2542762218 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1c4045020 con 0x7fa1d0143ff0 2024-04-16T12:57:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.775+0000 7fa1b77fe640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.775+0000 7f19c27fc640 1 -- 172.21.15.106:0/3318329332 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19cc059f20 con 0x7f19d006d5e0 2024-04-16T12:57:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.776+0000 7fa1ceffd640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.775+0000 7f6ceaffd640 1 -- 172.21.15.106:0/3901786490 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6cec0329f0 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.775+0000 7f6ceaffd640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6cdc06c920 0x7f6cdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.775+0000 7f6ceaffd640 1 -- 172.21.15.106:0/3901786490 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6cec0ad980 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.776+0000 7fa1b77fe640 1 -- 172.21.15.106:0/2542762218 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1c40adf60 con 0x7fa1d0143ff0 2024-04-16T12:57:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.777+0000 7f6cf9d9b640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6cdc06c920 0x7f6cdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.777+0000 7fa1ceffd640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0007d50 tx=0x7fa1c0007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.777+0000 7f6cf9d9b640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6cdc06c920 0x7f6cdc06ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0bad10 tx=0x7f6cf4004d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.778+0000 7fa1b77fe640 1 -- 172.21.15.106:0/2542762218 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1c404c030 con 0x7fa1d0143ff0 2024-04-16T12:57:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.781+0000 7f7e177fe640 1 -- 172.21.15.106:0/1371223048 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e2405ad90 con 0x7f7e28036b90 2024-04-16T12:57:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.782+0000 7f9cc17fa640 1 -- 172.21.15.106:0/1803727233 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9cb4056f00 con 0x7f9cc406f310 2024-04-16T12:57:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.783+0000 7f6ceaffd640 1 -- 172.21.15.106:0/3901786490 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6cec07b740 con 0x7f6cfc06e4c0 2024-04-16T12:57:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:23.791+0000 7f9cc17fa640 1 -- 172.21.15.106:0/1803727233 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9cb4058e60 con 0x7f9cc406f310 2024-04-16T12:57:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.183+0000 7fa9f4996640 1 -- 172.21.15.106:0/2823544604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa9f013e0c0 con 0x7fa9f0145d10 2024-04-16T12:57:24.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.184+0000 7fa9deffd640 1 -- 172.21.15.106:0/2823544604 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9e005a790 con 0x7fa9f0145d10 2024-04-16T12:57:24.187 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.188+0000 7fa9dcff9640 1 -- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa9d006c8f0 msgr2=0x7fa9d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.188+0000 7fa9dcff9640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa9d006c8f0 0x7fa9d006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8007fd0 tx=0x7fa9e8009040 comp rx=0 tx=0).stop 2024-04-16T12:57:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.188+0000 7fa9dcff9640 1 -- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f0145d10 msgr2=0x7fa9f00b9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.188+0000 7fa9dcff9640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f0145d10 0x7fa9f00b9c10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0011ca0 tx=0x7fa9e000f610 comp rx=0 tx=0).stop 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.188+0000 7fa9dcff9640 1 -- 172.21.15.106:0/2823544604 shutdown_connections 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.189+0000 7fa9dcff9640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa9d006c8f0 0x7fa9d006edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.189+0000 7fa9dcff9640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9f0146ae0 0x7fa9f00b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.189+0000 7fa9dcff9640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f0145d10 0x7fa9f00b9c10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.189+0000 7fa9dcff9640 1 --2- 172.21.15.106:0/2823544604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9d8005c00 0x7fa9f01451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.189+0000 7fa9dcff9640 1 -- 172.21.15.106:0/2823544604 >> 172.21.15.106:0/2823544604 conn(0x7fa9f009c5e0 msgr2=0x7fa9f009a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.189+0000 7fa9dcff9640 1 -- 172.21.15.106:0/2823544604 shutdown_connections 2024-04-16T12:57:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.189+0000 7fa9dcff9640 1 -- 172.21.15.106:0/2823544604 wait complete. 2024-04-16T12:57:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.192+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fafc8005850 con 0x7fafec13bf90 2024-04-16T12:57:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.192+0000 7fafe2ffd640 1 -- 172.21.15.106:0/3070974347 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fafe405a3a0 con 0x7fafec13bf90 2024-04-16T12:57:24.195 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.193+0000 7fa1cffff640 1 -- 172.21.15.106:0/2542762218 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa1d00b9000 con 0x7fa1d0143ff0 2024-04-16T12:57:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.193+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f19ac005850 con 0x7f19d006d5e0 2024-04-16T12:57:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.194+0000 7fa1b77fe640 1 -- 172.21.15.106:0/2542762218 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1c407bf10 con 0x7fa1d0143ff0 2024-04-16T12:57:24.196 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-04-16T12:57:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.194+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f06e0005580 con 0x7f07000b6570 2024-04-16T12:57:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.194+0000 7f06e77fe640 1 -- 172.21.15.106:0/2314955628 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06f807c3d0 con 0x7f07000b6570 2024-04-16T12:57:24.197 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-04-16T12:57:24.199 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-04-16T12:57:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.195+0000 7f19c27fc640 1 -- 172.21.15.106:0/3318329332 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19cc05e220 con 0x7f19d006d5e0 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fafd006c970 msgr2=0x7fafd006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fafd006c970 0x7fafd006ee30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fafe80011e0 tx=0x7fafe8007d30 comp rx=0 tx=0).stop 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafec13bf90 msgr2=0x7fafec145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafec13bf90 0x7fafec145330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fafe400caf0 tx=0x7fafe4002070 comp rx=0 tx=0).stop 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 shutdown_connections 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fafd006c970 0x7fafd006ee30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafec13bf90 0x7fafec145330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafec146460 0x7fafec13ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 --2- 172.21.15.106:0/3070974347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafec0b2a70 0x7fafec152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.196+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 >> 172.21.15.106:0/3070974347 conn(0x7fafec06c2c0 msgr2=0x7fafec0b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 shutdown_connections 2024-04-16T12:57:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fafe0ff9640 1 -- 172.21.15.106:0/3070974347 wait complete. 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fa1b57fa640 1 -- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa1bc06c8f0 msgr2=0x7fa1bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fa1b57fa640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0007d50 tx=0x7fa1c0007ca0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fa1b57fa640 1 -- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d0143ff0 msgr2=0x7fa1d01e1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fa1b57fa640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d0143ff0 0x7fa1d01e1ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00b9fd0 tx=0x7fa1c40046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fa1b57fa640 1 -- 172.21.15.106:0/2542762218 shutdown_connections 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fa1b57fa640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.197+0000 7fa1b57fa640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d0143ff0 0x7fa1d01e1ed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7fa1b57fa640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1d0143c10 0x7fa1d01e1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7fa1b57fa640 1 --2- 172.21.15.106:0/2542762218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d00affc0 0x7fa1d01521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7fa1b57fa640 1 -- 172.21.15.106:0/2542762218 >> 172.21.15.106:0/2542762218 conn(0x7fa1d006bfe0 msgr2=0x7fa1d00ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7fa1b57fa640 1 -- 172.21.15.106:0/2542762218 shutdown_connections 2024-04-16T12:57:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7fa1b57fa640 1 -- 172.21.15.106:0/2542762218 wait complete. 2024-04-16T12:57:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f06ec06c9c0 msgr2=0x7f06ec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f06ec06c9c0 0x7f06ec06ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0700139c20 tx=0x7f06f4006c40 comp rx=0 tx=0).stop 2024-04-16T12:57:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07000b6570 msgr2=0x7f0700133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07000b6570 0x7f0700133a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06f8033000 tx=0x7f06f8004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 shutdown_connections 2024-04-16T12:57:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f06ec06c9c0 0x7f06ec06ee80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f070013e3f0 0x7f0700133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07000b6570 0x7f0700133a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 --2- 172.21.15.106:0/2314955628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0700073270 0x7f07000b9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.198+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 >> 172.21.15.106:0/2314955628 conn(0x7f070006b9b0 msgr2=0x7f07000b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 shutdown_connections 2024-04-16T12:57:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f19b406c9c0 msgr2=0x7f19b406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f0705014640 1 -- 172.21.15.106:0/2314955628 wait complete. 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f19b406c9c0 0x7f19b406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19c802bf40 tx=0x7f19c8030000 comp rx=0 tx=0).stop 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19d006d5e0 msgr2=0x7f19d0097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19d006d5e0 0x7f19d0097d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00e900 tx=0x7f19cc00edc0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 shutdown_connections 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f19b406c9c0 0x7f19b406ee80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d01fe5c0 0x7f19d0159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.199+0000 7f19b3fff640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19d006d5e0 0x7f19d0097d70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.200+0000 7f19b3fff640 1 --2- 172.21.15.106:0/3318329332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d006d180 0x7f19d0095860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.200+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 >> 172.21.15.106:0/3318329332 conn(0x7f19d009c5e0 msgr2=0x7f19d0153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.200+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 shutdown_connections 2024-04-16T12:57:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.200+0000 7f19b3fff640 1 -- 172.21.15.106:0/3318329332 wait complete. 2024-04-16T12:57:24.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.201+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6cfc0691a0 con 0x7f6cfc06e4c0 2024-04-16T12:57:24.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.201+0000 7f6ceaffd640 1 -- 172.21.15.106:0/3901786490 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6cec07fa40 con 0x7f6cfc06e4c0 2024-04-16T12:57:24.209 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:24.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.204+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7e08005850 con 0x7f7e28036b90 2024-04-16T12:57:24.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.205+0000 7f7e177fe640 1 -- 172.21.15.106:0/1371223048 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e2405a690 con 0x7f7e28036b90 2024-04-16T12:57:24.209 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.205+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6cdc06c920 msgr2=0x7f6cdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.205+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6cdc06c920 0x7f6cdc06ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0bad10 tx=0x7f6cf4004d40 comp rx=0 tx=0).stop 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 msgr2=0x7f6cfc1e4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc1e4ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cec034040 tx=0x7f6cec0046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 shutdown_connections 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6cdc06c920 0x7f6cdc06ede0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0bad10 tx=0x7f6cf4004d40 comp rx=0 tx=0).stop 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6cfc0b5660 0x7f6cfc0b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cfc09b240 0x7f6cfc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 --2- 172.21.15.106:0/3901786490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cfc06e4c0 0x7f6cfc1e4ca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 >> 172.21.15.106:0/3901786490 conn(0x7f6cfc0ba550 msgr2=0x7f6cfc0b9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 shutdown_connections 2024-04-16T12:57:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.206+0000 7f6d00c0d640 1 -- 172.21.15.106:0/3901786490 wait complete. 2024-04-16T12:57:24.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7e1c06c9c0 msgr2=0x7f7e1c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7e1c06c9c0 0x7f7e1c06ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e3006afa0 tx=0x7f7e3006e040 comp rx=0 tx=0).stop 2024-04-16T12:57:24.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e28036b90 msgr2=0x7f7e280bf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e28036b90 0x7f7e280bf120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400d5f0 tx=0x7f7e2400d9f0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 shutdown_connections 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7e1c06c9c0 0x7f7e1c06ee80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e280d49a0 0x7f7e280bd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e280383b0 0x7f7e280d6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 --2- 172.21.15.106:0/1371223048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e28036b90 0x7f7e280bf120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 >> 172.21.15.106:0/1371223048 conn(0x7f7e2803a8d0 msgr2=0x7f7e280393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.209+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9ca8005580 con 0x7f9cc406f310 2024-04-16T12:57:24.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.210+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 shutdown_connections 2024-04-16T12:57:24.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.210+0000 7f7e157fa640 1 -- 172.21.15.106:0/1371223048 wait complete. 2024-04-16T12:57:24.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.210+0000 7f9cc17fa640 1 -- 172.21.15.106:0/1803727233 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9cb405d160 con 0x7f9cc406f310 2024-04-16T12:57:24.215 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-04-16T12:57:24.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9ca406c8f0 msgr2=0x7f9ca406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9ca406c8f0 0x7f9ca406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc035000 tx=0x7f9cbc008030 comp rx=0 tx=0).stop 2024-04-16T12:57:24.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406f310 msgr2=0x7f9cc4140160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:24.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406f310 0x7f9cc4140160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9cb401d7a0 tx=0x7f9cb401dc60 comp rx=0 tx=0).stop 2024-04-16T12:57:24.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 shutdown_connections 2024-04-16T12:57:24.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9ca406c8f0 0x7f9ca406edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cc41e2930 0x7f9cc41409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cc409cc90 0x7f9cc40b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 --2- 172.21.15.106:0/1803727233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9cc406f310 0x7f9cc4140160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:24.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.214+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 >> 172.21.15.106:0/1803727233 conn(0x7f9cc409d170 msgr2=0x7f9cc406e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:24.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.215+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 shutdown_connections 2024-04-16T12:57:24.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:24.215+0000 7f9cc9e15640 1 -- 172.21.15.106:0/1803727233 wait complete. 2024-04-16T12:57:24.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-16T12:57:24.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-16T12:57:24.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-04-16T12:57:24.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-16T12:57:24.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-04-16T12:57:24.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-04-16T12:57:24.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-16T12:57:25.214 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T12:57:25.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T12:57:25.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T12:57:25.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T12:57:25.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T12:57:25.230 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T12:57:25.231 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T12:57:25.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T12:57:25.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.375+0000 7f9fe2d24640 1 Processor -- start 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.375+0000 7f9fe2d24640 1 -- start start 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.377+0000 7f9fe2d24640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9fdc148aa0 0x7f9fdc150800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.377+0000 7f9fe2d24640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fdc0af7e0 con 0x7f9fdc09b410 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.377+0000 7f9fe2d24640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fdc06e8a0 con 0x7f9fdc06e4c0 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.377+0000 7f9fe2d24640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9fdc0b0190 con 0x7f9fdc148aa0 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.378+0000 7f9fe0ac0640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9fdc06e4c0 0x7f9fdc09ad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33602/0 (socket says 172.21.15.106:33602) 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.378+0000 7f9fe0ac0640 1 -- 172.21.15.106:0/4571409 learned_addr learned my addr 172.21.15.106:0/4571409 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.378+0000 7f9fe12c1640 1 --2- 172.21.15.106:0/4571409 >> v2:172.21.15.171:3300/0 conn(0x7f9fdc148aa0 0x7f9fdc150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.378+0000 7f9fe12c1640 1 -- 172.21.15.106:0/4571409 >> v1:172.21.15.171:6789/0 conn(0x7f9fdc06e4c0 legacy=0x7f9fdc09ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.378+0000 7f9fe12c1640 1 -- 172.21.15.106:0/4571409 >> v1:172.21.15.106:6789/0 conn(0x7f9fdc09b410 legacy=0x7f9fdc148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.378+0000 7f9fe12c1640 1 -- 172.21.15.106:0/4571409 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc0b1110 con 0x7f9fdc148aa0 2024-04-16T12:57:25.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.380+0000 7f9fe12c1640 1 --2- 172.21.15.106:0/4571409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc148aa0 0x7f9fdc150800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009720 tx=0x7f9fcc02b570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e065dadafc72caf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.380+0000 7f9fdb7fe640 1 -- 172.21.15.106:0/4571409 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc037070 con 0x7f9fdc148aa0 2024-04-16T12:57:25.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.380+0000 7f9fdb7fe640 1 -- 172.21.15.106:0/4571409 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc032600 con 0x7f9fdc148aa0 2024-04-16T12:57:25.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.382+0000 7f9fe2d24640 1 -- 172.21.15.106:0/4571409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc148aa0 msgr2=0x7f9fdc150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.382+0000 7f9fe2d24640 1 --2- 172.21.15.106:0/4571409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc148aa0 0x7f9fdc150800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009720 tx=0x7f9fcc02b570 comp rx=0 tx=0).stop 2024-04-16T12:57:25.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.382+0000 7f9fe2d24640 1 -- 172.21.15.106:0/4571409 shutdown_connections 2024-04-16T12:57:25.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.382+0000 7f9fe2d24640 1 --2- 172.21.15.106:0/4571409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc148aa0 0x7f9fdc150800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.382+0000 7f9fe2d24640 1 -- 172.21.15.106:0/4571409 >> 172.21.15.106:0/4571409 conn(0x7f9fdc0ba550 msgr2=0x7f9fdc0ba930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.382+0000 7f9fe2d24640 1 -- 172.21.15.106:0/4571409 shutdown_connections 2024-04-16T12:57:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.383+0000 7f9fe2d24640 1 -- 172.21.15.106:0/4571409 wait complete. 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.384+0000 7f9fe2d24640 1 Processor -- start 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.384+0000 7f9fe2d24640 1 -- start start 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe2d24640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc06e4c0 0x7f9fdc0b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe2d24640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc09b410 0x7f9fdc14f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe2d24640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fdc14d670 0x7f9fdc1f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe2d24640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0b6e50 con 0x7f9fdc14d670 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe2d24640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0b6cd0 con 0x7f9fdc06e4c0 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe2d24640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc0b0ca0 con 0x7f9fdc09b410 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fdbfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc09b410 0x7f9fdc14f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe12c1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fdc14d670 0x7f9fdc1f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fe0ac0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc06e4c0 0x7f9fdc0b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fdbfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc09b410 0x7f9fdc14f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46196/0 (socket says 172.21.15.106:46196) 2024-04-16T12:57:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.386+0000 7f9fdbfff640 1 -- 172.21.15.106:0/2608601975 learned_addr learned my addr 172.21.15.106:0/2608601975 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.387+0000 7f9fe12c1640 1 -- 172.21.15.106:0/2608601975 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc09b410 msgr2=0x7f9fdc14f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.387+0000 7f9fe12c1640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc09b410 0x7f9fdc14f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.387+0000 7f9fe12c1640 1 -- 172.21.15.106:0/2608601975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc06e4c0 msgr2=0x7f9fdc0b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.387+0000 7f9fe12c1640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc06e4c0 0x7f9fdc0b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.387+0000 7f9fe12c1640 1 -- 172.21.15.106:0/2608601975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc14e670 con 0x7f9fdc14d670 2024-04-16T12:57:25.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.387+0000 7f9fe12c1640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fdc14d670 0x7f9fdc1f5e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc032000 tx=0x7f9fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.389+0000 7f9fd97fa640 1 -- 172.21.15.106:0/2608601975 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc042030 con 0x7f9fdc14d670 2024-04-16T12:57:25.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.389+0000 7f9fe2d24640 1 -- 172.21.15.106:0/2608601975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc14ebc0 con 0x7f9fdc14d670 2024-04-16T12:57:25.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.389+0000 7f9fe2d24640 1 -- 172.21.15.106:0/2608601975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc14a350 con 0x7f9fdc14d670 2024-04-16T12:57:25.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.394+0000 7f9fd97fa640 1 -- 172.21.15.106:0/2608601975 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0325a0 con 0x7f9fdc14d670 2024-04-16T12:57:25.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.395+0000 7f9fd97fa640 1 -- 172.21.15.106:0/2608601975 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc037040 con 0x7f9fdc14d670 2024-04-16T12:57:25.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.395+0000 7f9fd97fa640 1 -- 172.21.15.106:0/2608601975 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fcc045070 con 0x7f9fdc14d670 2024-04-16T12:57:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.397+0000 7f9fd97fa640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9fc806c9f0 0x7f9fc806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.397+0000 7f9fe0ac0640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9fc806c9f0 0x7f9fc806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.398+0000 7f9fd97fa640 1 -- 172.21.15.106:0/2608601975 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fcc0adc00 con 0x7f9fdc14d670 2024-04-16T12:57:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.396+0000 7f9fe2d24640 1 -- 172.21.15.106:0/2608601975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fbc005290 con 0x7f9fdc14d670 2024-04-16T12:57:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.408+0000 7f9fe0ac0640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9fc806c9f0 0x7f9fc806eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40012e0 tx=0x7f9fd4005b70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.408+0000 7f9fd97fa640 1 -- 172.21.15.106:0/2608601975 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9fdc14ebc0 con 0x7f9fdc14d670 2024-04-16T12:57:25.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.433+0000 7fee94b58640 1 Processor -- start 2024-04-16T12:57:25.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.433+0000 7f74e6658640 1 Processor -- start 2024-04-16T12:57:25.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.433+0000 7fee94b58640 1 -- start start 2024-04-16T12:57:25.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.434+0000 7f74e6658640 1 -- start start 2024-04-16T12:57:25.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.434+0000 7fee94b58640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee900b1eb0 0x7fee900b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.434+0000 7fee94b58640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee900b2290 con 0x7fee900b0060 2024-04-16T12:57:25.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.434+0000 7fee94b58640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee900b0fd0 con 0x7fee9014c740 2024-04-16T12:57:25.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.434+0000 7fee94b58640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fee9014c220 con 0x7fee900b1eb0 2024-04-16T12:57:25.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7fee8ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fee9014c740 0x7fee901568d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33614/0 (socket says 172.21.15.106:33614) 2024-04-16T12:57:25.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7f74e6658640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74e00b6030 0x7f74e006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7fee8ffff640 1 -- 172.21.15.106:0/3771228749 learned_addr learned my addr 172.21.15.106:0/3771228749 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:25.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7f42c1260640 1 Processor -- start 2024-04-16T12:57:25.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7f42c1260640 1 -- start start 2024-04-16T12:57:25.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7f74e6658640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00727e0 0x7f74e0072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7f74e6658640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e009cd00 con 0x7f74e006e900 2024-04-16T12:57:25.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7f74e6658640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f74e00b6410 con 0x7f74e00b6030 2024-04-16T12:57:25.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7fee8f7fe640 1 --2- 172.21.15.106:0/3771228749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee900b1eb0 0x7fee900b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7f74e6658640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74e0073170 con 0x7f74e00727e0 2024-04-16T12:57:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.435+0000 7fee8e7fc640 1 -- 172.21.15.106:0/3771228749 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058572608 0 0) 0x7fee900b0fd0 con 0x7fee9014c740 2024-04-16T12:57:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7fee8e7fc640 1 -- 172.21.15.106:0/3771228749 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee78003520 con 0x7fee9014c740 2024-04-16T12:57:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7fee8e7fc640 1 -- 172.21.15.106:0/3771228749 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835793778 0 0) 0x7fee900b2290 con 0x7fee900b0060 2024-04-16T12:57:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7fee8e7fc640 1 -- 172.21.15.106:0/3771228749 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee900b0fd0 con 0x7fee900b0060 2024-04-16T12:57:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42c1260640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f42bc0679d0 0x7f42bc06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f5a55a1b640 1 Processor -- start 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42c1260640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42bc14cee0 0x7f42bc06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42c1260640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc0aedb0 con 0x7f42bc073480 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42c1260640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f42bc0afc50 con 0x7f42bc14cee0 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42c1260640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f42bc09edd0 con 0x7f42bc0679d0 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42bad9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f42bc0679d0 0x7f42bc06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42bad9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f42bc0679d0 0x7f42bc06f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53830/0 (socket says 172.21.15.106:53830) 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42bad9d640 1 -- 172.21.15.106:0/3328004412 learned_addr learned my addr 172.21.15.106:0/3328004412 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42bb59e640 1 --2- 172.21.15.106:0/3328004412 >> v2:172.21.15.106:3300/0 conn(0x7f42bc14cee0 0x7f42bc06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7fa2f9eba640 1 Processor -- start 2024-04-16T12:57:25.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42bad9d640 1 -- 172.21.15.106:0/3328004412 >> v2:172.21.15.106:3300/0 conn(0x7f42bc14cee0 msgr2=0x7f42bc06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42bad9d640 1 --2- 172.21.15.106:0/3328004412 >> v2:172.21.15.106:3300/0 conn(0x7f42bc14cee0 0x7f42bc06dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.436+0000 7f42bad9d640 1 -- 172.21.15.106:0/3328004412 >> v1:172.21.15.171:6789/0 conn(0x7f42bc073480 legacy=0x7f42bc14c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7f74e4e55640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f74e006e900 0x7f74e014c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33634/0 (socket says 172.21.15.106:33634) 2024-04-16T12:57:25.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7f74e5656640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74e00b6030 0x7f74e006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7f74e4e55640 1 -- 172.21.15.106:0/2316353521 learned_addr learned my addr 172.21.15.106:0/2316353521 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:25.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7f74e5e57640 1 --2- 172.21.15.106:0/2316353521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00727e0 0x7f74e0072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7fa2f9eba640 1 -- start start 2024-04-16T12:57:25.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7fee8f7fe640 1 -- 172.21.15.106:0/3771228749 >> v1:172.21.15.171:6789/0 conn(0x7fee9014c740 legacy=0x7fee901568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7fee8f7fe640 1 -- 172.21.15.106:0/3771228749 >> v1:172.21.15.106:6789/0 conn(0x7fee900b0060 legacy=0x7fee90073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7fee8f7fe640 1 -- 172.21.15.106:0/3771228749 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee900b3430 con 0x7fee900b1eb0 2024-04-16T12:57:25.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7f5a55a1b640 1 -- start start 2024-04-16T12:57:25.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a55a1b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5a480359e0 0x7f5a480d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f9eba640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa2f4071c50 0x7fa2f406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f9eba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f406bef0 0x7fa2f4145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f9eba640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa2f4146130 0x7fa2f414c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f9eba640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f4073660 con 0x7fa2f4071c50 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f9eba640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f4073ea0 con 0x7fa2f4146130 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f9eba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f4073890 con 0x7fa2f406bef0 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a55a1b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a48029d80 con 0x7f5a480365a0 2024-04-16T12:57:25.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.437+0000 7f42bad9d640 1 -- 172.21.15.106:0/3328004412 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc067db0 con 0x7f42bc0679d0 2024-04-16T12:57:25.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f74e5656640 1 -- 172.21.15.106:0/2316353521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00727e0 msgr2=0x7f74e0072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f74e5656640 1 --2- 172.21.15.106:0/2316353521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00727e0 0x7f74e0072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f74e5656640 1 -- 172.21.15.106:0/2316353521 >> v1:172.21.15.171:6789/0 conn(0x7f74e006e900 legacy=0x7f74e014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f74e5656640 1 -- 172.21.15.106:0/2316353521 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e00722e0 con 0x7f74e00b6030 2024-04-16T12:57:25.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a55a1b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a48035e70 con 0x7f5a48035600 2024-04-16T12:57:25.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f3fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa2f4146130 0x7fa2f414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f3fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa2f4146130 0x7fa2f414c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53850/0 (socket says 172.21.15.106:53850) 2024-04-16T12:57:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f3fff640 1 -- 172.21.15.106:0/2005437815 learned_addr learned my addr 172.21.15.106:0/2005437815 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f37fe640 1 --2- 172.21.15.106:0/2005437815 >> v2:172.21.15.106:3300/0 conn(0x7fa2f4071c50 0x7fa2f406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7fa2f2ffd640 1 --2- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f406bef0 0x7fa2f4145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a55a1b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5a48036a20 con 0x7f5a480359e0 2024-04-16T12:57:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f42bad9d640 1 --2- 172.21.15.106:0/3328004412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 0x7f42bc06f460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42bc067fc0 tx=0x7f42ac02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb0ddc04c99b4792 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7fa2f3fff640 1 -- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f406bef0 msgr2=0x7fa2f4145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7fa2f3fff640 1 --2- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f406bef0 0x7fa2f4145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7fa2f3fff640 1 -- 172.21.15.106:0/2005437815 >> v2:172.21.15.106:3300/0 conn(0x7fa2f4071c50 msgr2=0x7fa2f406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7fa2f3fff640 1 --2- 172.21.15.106:0/2005437815 >> v2:172.21.15.106:3300/0 conn(0x7fa2f4071c50 0x7fa2f406b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7fa2f3fff640 1 -- 172.21.15.106:0/2005437815 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f4072030 con 0x7fa2f4146130 2024-04-16T12:57:25.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f74e5656640 1 --2- 172.21.15.106:0/2316353521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e00b6030 0x7f74e006e3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0097a0 tx=0x7f74dc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef548d00f29c0ceb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a4f7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5a480359e0 0x7f5a480d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a4f7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5a480359e0 0x7f5a480d3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53846/0 (socket says 172.21.15.106:53846) 2024-04-16T12:57:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/3800427108 learned_addr learned my addr 172.21.15.106:0/3800427108 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/3800427108 >> v1:172.21.15.171:6789/0 conn(0x7f5a48035600 legacy=0x7f5a480337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.438+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/3800427108 >> v1:172.21.15.106:6789/0 conn(0x7f5a480365a0 legacy=0x7f5a480c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/3800427108 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a48036100 con 0x7f5a480359e0 2024-04-16T12:57:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f42b9d9b640 1 -- 172.21.15.106:0/3328004412 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac035020 con 0x7f42bc0679d0 2024-04-16T12:57:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f42b9d9b640 1 -- 172.21.15.106:0/3328004412 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac031870 con 0x7f42bc0679d0 2024-04-16T12:57:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f74d7fff640 1 -- 172.21.15.106:0/2316353521 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc031780 con 0x7f74e00b6030 2024-04-16T12:57:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f04c09d5640 1 Processor -- start 2024-04-16T12:57:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7fee8f7fe640 1 --2- 172.21.15.106:0/3771228749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee900b1eb0 0x7fee900b09b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee80009750 tx=0x7fee8002b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1adcd548c68cba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.439+0000 7f42b9d9b640 1 -- 172.21.15.106:0/3328004412 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac031c40 con 0x7f42bc0679d0 2024-04-16T12:57:25.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f74d7fff640 1 -- 172.21.15.106:0/2316353521 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74dc037070 con 0x7f74e00b6030 2024-04-16T12:57:25.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7fee8e7fc640 1 -- 172.21.15.106:0/3771228749 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80037070 con 0x7fee900b1eb0 2024-04-16T12:57:25.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f74d7fff640 1 -- 172.21.15.106:0/2316353521 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc031b40 con 0x7f74e00b6030 2024-04-16T12:57:25.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f04c09d5640 1 -- start start 2024-04-16T12:57:25.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7fee8e7fc640 1 -- 172.21.15.106:0/3771228749 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee80030510 con 0x7fee900b1eb0 2024-04-16T12:57:25.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7fee8e7fc640 1 -- 172.21.15.106:0/3771228749 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee880019f0 con 0x7fee900b1eb0 2024-04-16T12:57:25.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f42c1260640 1 -- 172.21.15.106:0/3328004412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 msgr2=0x7f42bc06f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f42c1260640 1 --2- 172.21.15.106:0/3328004412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 0x7f42bc06f460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42bc067fc0 tx=0x7f42ac02b910 comp rx=0 tx=0).stop 2024-04-16T12:57:25.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7fa2f3fff640 1 --2- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4146130 0x7fa2f414c200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40b49b0 tx=0x7fa2ec02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2cba48e841823e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f5a4f7fe640 1 --2- 172.21.15.106:0/3800427108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 0x7f5a480d3f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a5006afa0 tx=0x7f5a500aff20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592ea67da6affc80 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f5a4dffb640 1 -- 172.21.15.106:0/3800427108 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500b6070 con 0x7f5a480359e0 2024-04-16T12:57:25.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f5a4dffb640 1 -- 172.21.15.106:0/3800427108 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a500b0d90 con 0x7f5a480359e0 2024-04-16T12:57:25.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f5a4dffb640 1 -- 172.21.15.106:0/3800427108 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500ba600 con 0x7f5a480359e0 2024-04-16T12:57:25.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.440+0000 7f898a5a8640 1 Processor -- start 2024-04-16T12:57:25.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 -- 172.21.15.106:0/2316353521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e00b6030 msgr2=0x7f74e006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 --2- 172.21.15.106:0/2316353521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e00b6030 0x7f74e006e3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0097a0 tx=0x7f74dc02b820 comp rx=0 tx=0).stop 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 -- 172.21.15.106:0/2316353521 shutdown_connections 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 --2- 172.21.15.106:0/2316353521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00727e0 0x7f74e0072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 --2- 172.21.15.106:0/2316353521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e00b6030 0x7f74e006e3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 -- 172.21.15.106:0/2316353521 >> 172.21.15.106:0/2316353521 conn(0x7f74e009d170 msgr2=0x7f74e009d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f42c1260640 1 -- 172.21.15.106:0/3328004412 shutdown_connections 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f42c1260640 1 --2- 172.21.15.106:0/3328004412 >> v2:172.21.15.106:3300/0 conn(0x7f42bc14cee0 0x7f42bc06dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f42c1260640 1 --2- 172.21.15.106:0/3328004412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 0x7f42bc06f460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f42c1260640 1 -- 172.21.15.106:0/3328004412 >> 172.21.15.106:0/3328004412 conn(0x7f42bc0b6e30 msgr2=0x7f42bc06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f898a5a8640 1 -- start start 2024-04-16T12:57:25.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fee94b58640 1 -- 172.21.15.106:0/3771228749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee900b1eb0 msgr2=0x7fee900b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fee94b58640 1 --2- 172.21.15.106:0/3771228749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee900b1eb0 0x7fee900b09b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee80009750 tx=0x7fee8002b660 comp rx=0 tx=0).stop 2024-04-16T12:57:25.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fee94b58640 1 -- 172.21.15.106:0/3771228749 shutdown_connections 2024-04-16T12:57:25.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fee94b58640 1 --2- 172.21.15.106:0/3771228749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee900b1eb0 0x7fee900b09b0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee80009750 tx=0x7fee8002b660 comp rx=0 tx=0).stop 2024-04-16T12:57:25.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fee94b58640 1 -- 172.21.15.106:0/3771228749 >> 172.21.15.106:0/3771228749 conn(0x7fee9006c2c0 msgr2=0x7fee900b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f42c1260640 1 -- 172.21.15.106:0/3328004412 shutdown_connections 2024-04-16T12:57:25.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f42c1260640 1 -- 172.21.15.106:0/3328004412 wait complete. 2024-04-16T12:57:25.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f5a55a1b640 1 -- 172.21.15.106:0/3800427108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 msgr2=0x7f5a480d3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fee94b58640 1 -- 172.21.15.106:0/3771228749 shutdown_connections 2024-04-16T12:57:25.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f04c09d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f04bc14b7d0 0x7f04bc153de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f5a55a1b640 1 --2- 172.21.15.106:0/3800427108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 0x7f5a480d3f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a5006afa0 tx=0x7f5a500aff20 comp rx=0 tx=0).stop 2024-04-16T12:57:25.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 -- 172.21.15.106:0/2316353521 shutdown_connections 2024-04-16T12:57:25.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f04ba59c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f04bc0bdfa0 0x7f04bc141dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33640/0 (socket says 172.21.15.106:33640) 2024-04-16T12:57:25.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f04ba59c640 1 -- 172.21.15.106:0/3150474133 learned_addr learned my addr 172.21.15.106:0/3150474133 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:25.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f04bad9d640 1 --2- 172.21.15.106:0/3150474133 >> v2:172.21.15.171:3300/0 conn(0x7f04bc14b7d0 0x7f04bc153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f74e6658640 1 -- 172.21.15.106:0/2316353521 wait complete. 2024-04-16T12:57:25.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f04c09d5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04bc0be380 con 0x7f04bc14b390 2024-04-16T12:57:25.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f04c09d5640 1 -- 172.21.15.106:0/3150474133 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04bc0b4c30 con 0x7f04bc0bdfa0 2024-04-16T12:57:25.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f04c09d5640 1 -- 172.21.15.106:0/3150474133 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f04bc0b4fa0 con 0x7f04bc14b7d0 2024-04-16T12:57:25.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fee94b58640 1 -- 172.21.15.106:0/3771228749 wait complete. 2024-04-16T12:57:25.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f5a55a1b640 1 -- 172.21.15.106:0/3800427108 shutdown_connections 2024-04-16T12:57:25.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7f5a55a1b640 1 --2- 172.21.15.106:0/3800427108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 0x7f5a480d3f50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f5a55a1b640 1 -- 172.21.15.106:0/3800427108 >> 172.21.15.106:0/3800427108 conn(0x7f5a4803a8a0 msgr2=0x7f5a4803acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.441+0000 7fa2f27fc640 1 -- 172.21.15.106:0/2005437815 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec02c9f0 con 0x7fa2f4146130 2024-04-16T12:57:25.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7fa2f27fc640 1 -- 172.21.15.106:0/2005437815 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec02cb90 con 0x7fa2f4146130 2024-04-16T12:57:25.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7fa2f27fc640 1 -- 172.21.15.106:0/2005437815 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0343f0 con 0x7fa2f4146130 2024-04-16T12:57:25.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f898a5a8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89840679d0 0x7f8984072a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f898a5a8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8984154840 0x7f8984156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f898a5a8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8984067db0 con 0x7f8984145c80 2024-04-16T12:57:25.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f898a5a8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8984070f30 con 0x7f89840679d0 2024-04-16T12:57:25.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f898a5a8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f89840b50c0 con 0x7f8984154840 2024-04-16T12:57:25.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f5a55a1b640 1 -- 172.21.15.106:0/3800427108 shutdown_connections 2024-04-16T12:57:25.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f8988b45640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8984154840 0x7f8984156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f8988b45640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8984154840 0x7f8984156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53872/0 (socket says 172.21.15.106:53872) 2024-04-16T12:57:25.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f8988b45640 1 -- 172.21.15.106:0/1618037792 learned_addr learned my addr 172.21.15.106:0/1618037792 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f5a55a1b640 1 -- 172.21.15.106:0/3800427108 wait complete. 2024-04-16T12:57:25.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7fee94b58640 1 Processor -- start 2024-04-16T12:57:25.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f8988b45640 1 -- 172.21.15.106:0/1618037792 >> v2:172.21.15.106:3300/0 conn(0x7f89840679d0 msgr2=0x7f8984072a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f74e6658640 1 Processor -- start 2024-04-16T12:57:25.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f04bad9d640 1 -- 172.21.15.106:0/3150474133 >> v1:172.21.15.171:6789/0 conn(0x7f04bc0bdfa0 legacy=0x7f04bc141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f04bad9d640 1 -- 172.21.15.106:0/3150474133 >> v1:172.21.15.106:6789/0 conn(0x7f04bc14b390 legacy=0x7f04bc1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.442+0000 7f04bad9d640 1 -- 172.21.15.106:0/3150474133 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc1424d0 con 0x7f04bc14b7d0 2024-04-16T12:57:25.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f8988b45640 1 --2- 172.21.15.106:0/1618037792 >> v2:172.21.15.106:3300/0 conn(0x7f89840679d0 0x7f8984072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f8988b45640 1 -- 172.21.15.106:0/1618037792 >> v1:172.21.15.171:6789/0 conn(0x7f8984145c80 legacy=0x7f89841460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:25.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f8988b45640 1 -- 172.21.15.106:0/1618037792 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89840b53a0 con 0x7f8984154840 2024-04-16T12:57:25.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f74e6658640 1 -- start start 2024-04-16T12:57:25.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f42c1260640 1 Processor -- start 2024-04-16T12:57:25.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7f42c1260640 1 -- start start 2024-04-16T12:57:25.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4146130 msgr2=0x7fa2f414c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4146130 0x7fa2f414c200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40b49b0 tx=0x7fa2ec02be50 comp rx=0 tx=0).stop 2024-04-16T12:57:25.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f5a55a1b640 1 Processor -- start 2024-04-16T12:57:25.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f04bad9d640 1 --2- 172.21.15.106:0/3150474133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b7d0 0x7f04bc153de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009720 tx=0x7f04ac02b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=231a698d29a65110 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.443+0000 7fee94b58640 1 -- start start 2024-04-16T12:57:25.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee94b58640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee900b0060 0x7fee90148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f04b959a640 1 -- 172.21.15.106:0/3150474133 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac037070 con 0x7f04bc14b7d0 2024-04-16T12:57:25.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee94b58640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9014c740 0x7fee901e2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee94b58640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee901e2790 0x7fee90142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f04b959a640 1 -- 172.21.15.106:0/3150474133 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac030710 con 0x7f04bc14b7d0 2024-04-16T12:57:25.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f5a55a1b640 1 -- start start 2024-04-16T12:57:25.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f04b959a640 1 -- 172.21.15.106:0/3150474133 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac030ae0 con 0x7f04bc14b7d0 2024-04-16T12:57:25.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f8988b45640 1 --2- 172.21.15.106:0/1618037792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984154840 0x7f8984156c30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8984073c30 tx=0x7f897402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f3a46ebb95c003 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f8982ffd640 1 -- 172.21.15.106:0/1618037792 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974035020 con 0x7f8984154840 2024-04-16T12:57:25.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f74e6658640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e006e900 0x7f74e014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f74e6658640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74e00727e0 0x7f74e014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f8982ffd640 1 -- 172.21.15.106:0/1618037792 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974031870 con 0x7f8984154840 2024-04-16T12:57:25.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f8982ffd640 1 -- 172.21.15.106:0/1618037792 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974031c40 con 0x7f8984154840 2024-04-16T12:57:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2005437815 shutdown_connections 2024-04-16T12:57:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4146130 0x7fa2f414c200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2005437815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f406bef0 0x7fa2f4145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2005437815 >> v2:172.21.15.106:3300/0 conn(0x7fa2f4071c50 0x7fa2f406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2005437815 >> 172.21.15.106:0/2005437815 conn(0x7fa2f40ba310 msgr2=0x7fa2f40ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42c1260640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 0x7f42bc144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42c1260640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42bc073480 0x7f42bc1e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42ba59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42bc073480 0x7f42bc1e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42ba59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42bc073480 0x7f42bc1e9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42906/0 (socket says 172.21.15.106:42906) 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42bad9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 0x7f42bc144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42ba59c640 1 -- 172.21.15.106:0/1565378449 learned_addr learned my addr 172.21.15.106:0/1565378449 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42c1260640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42bc14cee0 0x7f42bc0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc06ea20 con 0x7f42bc073480 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc06ed30 con 0x7f42bc0679d0 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f42bc156ad0 con 0x7f42bc14cee0 2024-04-16T12:57:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7f42bb59e640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42bc14cee0 0x7f42bc0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a55a1b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a48035600 0x7f5a48154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e6658640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00b6030 0x7f74e0144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e6658640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f74e014cad0 con 0x7f74e006e900 2024-04-16T12:57:25.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e6658640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74e014d220 con 0x7f74e00727e0 2024-04-16T12:57:25.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e6658640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74e014cc50 con 0x7f74e00b6030 2024-04-16T12:57:25.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a55a1b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 0x7f5a480bf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a55a1b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a480365a0 0x7f5a480cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a55a1b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48033ee0 con 0x7f5a480365a0 2024-04-16T12:57:25.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42bb59e640 1 -- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 msgr2=0x7f42bc144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42bb59e640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 0x7f42bc144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42bb59e640 1 -- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42bc073480 msgr2=0x7f42bc1e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42bb59e640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42bc073480 0x7f42bc1e9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42bb59e640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc0b1d90 con 0x7f42bc14cee0 2024-04-16T12:57:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f04c09d5640 1 -- 172.21.15.106:0/3150474133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b7d0 msgr2=0x7f04bc153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a55a1b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48029ff0 con 0x7f5a480359e0 2024-04-16T12:57:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a55a1b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a480c8cd0 con 0x7f5a48035600 2024-04-16T12:57:25.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f04c09d5640 1 --2- 172.21.15.106:0/3150474133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b7d0 0x7f04bc153de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009720 tx=0x7f04ac02b620 comp rx=0 tx=0).stop 2024-04-16T12:57:25.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e5e57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00b6030 0x7f74e0144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e5e57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00b6030 0x7f74e0144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46264/0 (socket says 172.21.15.106:46264) 2024-04-16T12:57:25.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e5e57640 1 -- 172.21.15.106:0/2713490354 learned_addr learned my addr 172.21.15.106:0/2713490354 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42bb59e640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42bc14cee0 0x7f42bc0b35a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f42b400eba0 tx=0x7f42b400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a4f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a480365a0 0x7f5a480cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2005437815 shutdown_connections 2024-04-16T12:57:25.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a4effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a48035600 0x7f5a48154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a4f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a480365a0 0x7f5a480cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42934/0 (socket says 172.21.15.106:42934) 2024-04-16T12:57:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/182532904 learned_addr learned my addr 172.21.15.106:0/182532904 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f74e4e55640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74e00727e0 0x7f74e014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2005437815 wait complete. 2024-04-16T12:57:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f898a5a8640 1 -- 172.21.15.106:0/1618037792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984154840 msgr2=0x7f8984156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f898a5a8640 1 --2- 172.21.15.106:0/1618037792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984154840 0x7f8984156c30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8984073c30 tx=0x7f897402b910 comp rx=0 tx=0).stop 2024-04-16T12:57:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee94b58640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fee9014cd70 con 0x7fee901e2790 2024-04-16T12:57:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee94b58640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fee9014cbf0 con 0x7fee900b0060 2024-04-16T12:57:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee94b58640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fee9014cef0 con 0x7fee9014c740 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee8ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee901e2790 0x7fee90142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee8ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee901e2790 0x7fee90142230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42914/0 (socket says 172.21.15.106:42914) 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee8ffff640 1 -- 172.21.15.106:0/1390836153 learned_addr learned my addr 172.21.15.106:0/1390836153 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.444+0000 7fee8f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee900b0060 0x7fee90148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8effd640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9014c740 0x7fee901e2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8f7fe640 1 -- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9014c740 msgr2=0x7fee901e2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8f7fe640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9014c740 0x7fee901e2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8f7fe640 1 -- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee901e2790 msgr2=0x7fee90142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8f7fe640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee901e2790 0x7fee90142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8f7fe640 1 -- 172.21.15.106:0/1390836153 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee901496b0 con 0x7fee900b0060 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8ffff640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee901e2790 0x7fee90142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7fee8effd640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9014c740 0x7fee901e2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f74e5e57640 1 -- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74e00727e0 msgr2=0x7f74e014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f74e5e57640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74e00727e0 0x7f74e014db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f74e5e57640 1 -- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e006e900 msgr2=0x7f74e014fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42a37fe640 1 -- 172.21.15.106:0/1565378449 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4018020 con 0x7f42bc14cee0 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42a37fe640 1 -- 172.21.15.106:0/1565378449 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b400cd20 con 0x7f42bc14cee0 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f42a37fe640 1 -- 172.21.15.106:0/1565378449 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40146c0 con 0x7f42bc14cee0 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc0b2070 con 0x7f42bc14cee0 2024-04-16T12:57:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42bc14fa80 con 0x7f42bc14cee0 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f04c09d5640 1 -- 172.21.15.106:0/3150474133 shutdown_connections 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f04c09d5640 1 --2- 172.21.15.106:0/3150474133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b7d0 0x7f04bc153de0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f04c09d5640 1 -- 172.21.15.106:0/3150474133 >> 172.21.15.106:0/3150474133 conn(0x7f04bc067dc0 msgr2=0x7f04bc0bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.445+0000 7f5a4e7fc640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 0x7f5a480bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/182532904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a48035600 msgr2=0x7f5a48154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f5a4f7fe640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a48035600 0x7f5a48154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/182532904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 msgr2=0x7f5a480bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f5a4f7fe640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 0x7f5a480bf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f5a4f7fe640 1 -- 172.21.15.106:0/182532904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a480ccb10 con 0x7f5a480365a0 2024-04-16T12:57:25.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f5a4f7fe640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a480365a0 0x7f5a480cacf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000b60 tx=0x7f5a500657c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f898a5a8640 1 -- 172.21.15.106:0/1618037792 shutdown_connections 2024-04-16T12:57:25.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f898a5a8640 1 --2- 172.21.15.106:0/1618037792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984154840 0x7f8984156c30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f898a5a8640 1 --2- 172.21.15.106:0/1618037792 >> v2:172.21.15.106:3300/0 conn(0x7f89840679d0 0x7f8984072a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f898a5a8640 1 -- 172.21.15.106:0/1618037792 >> 172.21.15.106:0/1618037792 conn(0x7f89840b63b0 msgr2=0x7f89840b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f898a5a8640 1 -- 172.21.15.106:0/1618037792 shutdown_connections 2024-04-16T12:57:25.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f898a5a8640 1 -- 172.21.15.106:0/1618037792 wait complete. 2024-04-16T12:57:25.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f74e5656640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e006e900 0x7f74e014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f74e5e57640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e006e900 0x7f74e014fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f74e5e57640 1 -- 172.21.15.106:0/2713490354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e014f090 con 0x7f74e00b6030 2024-04-16T12:57:25.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.446+0000 7f04c09d5640 1 -- 172.21.15.106:0/3150474133 shutdown_connections 2024-04-16T12:57:25.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f74e5656640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e006e900 0x7f74e014fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:25.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f04c09d5640 1 -- 172.21.15.106:0/3150474133 wait complete. 2024-04-16T12:57:25.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7fee8f7fe640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee900b0060 0x7fee90148de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee80032000 tx=0x7fee800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f5a37fff640 1 -- 172.21.15.106:0/182532904 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500c9020 con 0x7f5a480365a0 2024-04-16T12:57:25.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f5a55a1b640 1 -- 172.21.15.106:0/182532904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a48154240 con 0x7f5a480365a0 2024-04-16T12:57:25.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f5a37fff640 1 -- 172.21.15.106:0/182532904 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a500c5880 con 0x7f5a480365a0 2024-04-16T12:57:25.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f5a37fff640 1 -- 172.21.15.106:0/182532904 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500c5c30 con 0x7f5a480365a0 2024-04-16T12:57:25.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42bc0691a0 con 0x7f42bc14cee0 2024-04-16T12:57:25.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7fee77fff640 1 -- 172.21.15.106:0/1390836153 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80037070 con 0x7fee900b0060 2024-04-16T12:57:25.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7fa2f9eba640 1 Processor -- start 2024-04-16T12:57:25.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.448+0000 7fa2f9eba640 1 -- start start 2024-04-16T12:57:25.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7f5a55a1b640 1 -- 172.21.15.106:0/182532904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a480ca7d0 con 0x7f5a480365a0 2024-04-16T12:57:25.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.447+0000 7fee77fff640 1 -- 172.21.15.106:0/1390836153 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee80038040 con 0x7fee900b0060 2024-04-16T12:57:25.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.448+0000 7f898a5a8640 1 Processor -- start 2024-04-16T12:57:25.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.448+0000 7f898a5a8640 1 -- start start 2024-04-16T12:57:25.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.448+0000 7fee77fff640 1 -- 172.21.15.106:0/1390836153 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80037070 con 0x7fee900b0060 2024-04-16T12:57:25.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.448+0000 7f42a37fe640 1 -- 172.21.15.106:0/1565378449 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42b4005d10 con 0x7f42bc14cee0 2024-04-16T12:57:25.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.448+0000 7f04c09d5640 1 Processor -- start 2024-04-16T12:57:25.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.448+0000 7f04c09d5640 1 -- start start 2024-04-16T12:57:25.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee90071c30 con 0x7fee900b0060 2024-04-16T12:57:25.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee90072830 con 0x7fee900b0060 2024-04-16T12:57:25.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7fa2f9eba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f406bef0 0x7fa2f414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f898a5a8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89840679d0 0x7f8984135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7fa2f9eba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4071c50 0x7fa2f41e1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f898a5a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984145c80 0x7f8984143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f898a5a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8984154840 0x7f8984133250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f42a37fe640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42a806c9c0 0x7f42a806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f898a5a8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8984070a20 con 0x7f89840679d0 2024-04-16T12:57:25.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f898a5a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89840708a0 con 0x7f8984145c80 2024-04-16T12:57:25.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f898a5a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89840b60a0 con 0x7f8984154840 2024-04-16T12:57:25.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7fa2f9eba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f4146130 0x7fa2f413bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f74e5e57640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00b6030 0x7f74e0144150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f74d000e930 tx=0x7f74d000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f42a37fe640 1 -- 172.21.15.106:0/1565378449 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f42b408c660 con 0x7f42bc14cee0 2024-04-16T12:57:25.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f89837fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984145c80 0x7f8984143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f8988b45640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8984154840 0x7f8984133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f89837fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984145c80 0x7f8984143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53898/0 (socket says 172.21.15.106:53898) 2024-04-16T12:57:25.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f89837fe640 1 -- 172.21.15.106:0/3418465270 learned_addr learned my addr 172.21.15.106:0/3418465270 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f04c09d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04bc0bdfa0 0x7f04bc0ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f04c09d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b390 0x7f04bc13d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48005390 con 0x7f5a480365a0 2024-04-16T12:57:25.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f04c09d5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04bc14b7d0 0x7f04bc13de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04c09d5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc0b6650 con 0x7f04bc14b7d0 2024-04-16T12:57:25.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04c09d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc0b43e0 con 0x7f04bc14b390 2024-04-16T12:57:25.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04c09d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f04bc0b67d0 con 0x7f04bc0bdfa0 2024-04-16T12:57:25.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04bad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04bc14b7d0 0x7f04bc13de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04ba59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04bc0bdfa0 0x7f04bc0ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04ba59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04bc0bdfa0 0x7f04bc0ba0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46302/0 (socket says 172.21.15.106:46302) 2024-04-16T12:57:25.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04ba59c640 1 -- 172.21.15.106:0/2192418501 learned_addr learned my addr 172.21.15.106:0/2192418501 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04bad9d640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04bc14b7d0 0x7f04bc13de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42962/0 (socket says 172.21.15.106:42962) 2024-04-16T12:57:25.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04b9d9b640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b390 0x7f04bc13d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7f8983fff640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89840679d0 0x7f8984135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f89837fe640 1 -- 172.21.15.106:0/3418465270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8984154840 msgr2=0x7f8984133250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f89837fe640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8984154840 0x7f8984133250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f89837fe640 1 -- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89840679d0 msgr2=0x7f8984135930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f89837fe640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89840679d0 0x7f8984135930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f89837fe640 1 -- 172.21.15.106:0/3418465270 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8984142570 con 0x7f8984145c80 2024-04-16T12:57:25.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.449+0000 7fa2f37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f406bef0 0x7fa2f414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7fa2f9eba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f414c8c0 con 0x7fa2f406bef0 2024-04-16T12:57:25.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f8983fff640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89840679d0 0x7f8984135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:25.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7fa2f37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f406bef0 0x7fa2f414fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42938/0 (socket says 172.21.15.106:42938) 2024-04-16T12:57:25.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7fa2f37fe640 1 -- 172.21.15.106:0/2171317736 learned_addr learned my addr 172.21.15.106:0/2171317736 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:25.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f414c740 con 0x7fa2f4071c50 2024-04-16T12:57:25.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f414ca40 con 0x7fa2f4146130 2024-04-16T12:57:25.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7fa2f2ffd640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4071c50 0x7fa2f41e1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f42bad9d640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42a806c9c0 0x7f42a806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7fa2f3fff640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f4146130 0x7fa2f413bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f89837fe640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984145c80 0x7f8984143e80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f897800c460 tx=0x7f897800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04bad9d640 1 -- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04bc0bdfa0 msgr2=0x7f04bc0ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7f8980ff9640 1 -- 172.21.15.106:0/3418465270 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978016020 con 0x7f8984145c80 2024-04-16T12:57:25.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fa2f2ffd640 1 -- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f4146130 msgr2=0x7fa2f413bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fa2f2ffd640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f4146130 0x7fa2f413bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fa2f2ffd640 1 -- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f406bef0 msgr2=0x7fa2f414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fa2f2ffd640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f406bef0 0x7fa2f414fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8984145110 con 0x7f8984145c80 2024-04-16T12:57:25.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89841427e0 con 0x7f8984145c80 2024-04-16T12:57:25.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fa2f2ffd640 1 -- 172.21.15.106:0/2171317736 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f4146c00 con 0x7fa2f4071c50 2024-04-16T12:57:25.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7f8980ff9640 1 -- 172.21.15.106:0/3418465270 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8978012870 con 0x7f8984145c80 2024-04-16T12:57:25.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7f8980ff9640 1 -- 172.21.15.106:0/3418465270 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978012c60 con 0x7f8984145c80 2024-04-16T12:57:25.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee90068a90 con 0x7fee900b0060 2024-04-16T12:57:25.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04bad9d640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04bc0bdfa0 0x7f04bc0ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7f5a37fff640 1 -- 172.21.15.106:0/182532904 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a500cc020 con 0x7f5a480365a0 2024-04-16T12:57:25.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fee77fff640 1 -- 172.21.15.106:0/1390836153 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee80043020 con 0x7fee900b0060 2024-04-16T12:57:25.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04bad9d640 1 -- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b390 msgr2=0x7f04bc13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04bad9d640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b390 0x7f04bc13d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04bad9d640 1 -- 172.21.15.106:0/2192418501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc0b3d80 con 0x7f04bc14b7d0 2024-04-16T12:57:25.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.450+0000 7f04b9d9b640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b390 0x7f04bc13d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:25.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7fee77fff640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fee7c06caf0 0x7fee7c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7f42bad9d640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42a806c9c0 0x7f42a806ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42ac036000 tx=0x7f42ac03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7f04bad9d640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04bc14b7d0 0x7f04bc13de70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04ac032000 tx=0x7f04ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.451+0000 7fa2f2ffd640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4071c50 0x7fa2f41e1e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e8a0 tx=0x7fa2e000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7f5a37fff640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5a3c06c9c0 0x7f5a3c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7f5a37fff640 1 -- 172.21.15.106:0/182532904 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5a50131f70 con 0x7f5a480365a0 2024-04-16T12:57:25.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7fee77fff640 1 -- 172.21.15.106:0/1390836153 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee800ac4a0 con 0x7fee900b0060 2024-04-16T12:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8964005290 con 0x7f8984145c80 2024-04-16T12:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7f5a4effd640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5a3c06c9c0 0x7f5a3c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.452+0000 7fee8effd640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fee7c06caf0 0x7fee7c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.453+0000 7fee8effd640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fee7c06caf0 0x7fee7c06efb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fee901e2e80 tx=0x7fee84009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.453+0000 7f5a4effd640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5a3c06c9c0 0x7f5a3c06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a44006fd0 tx=0x7f5a44009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.454+0000 7f42a37fe640 1 -- 172.21.15.106:0/1565378449 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42b4022030 con 0x7f42bc14cee0 2024-04-16T12:57:25.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.454+0000 7f74d5ffb640 1 -- 172.21.15.106:0/2713490354 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0017070 con 0x7f74e00b6030 2024-04-16T12:57:25.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.454+0000 7f74d5ffb640 1 -- 172.21.15.106:0/2713490354 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d000c980 con 0x7f74e00b6030 2024-04-16T12:57:25.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.455+0000 7f74d5ffb640 1 -- 172.21.15.106:0/2713490354 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d000cd70 con 0x7f74e00b6030 2024-04-16T12:57:25.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.455+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e00b0710 con 0x7f74e00b6030 2024-04-16T12:57:25.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.455+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e014a780 con 0x7f74e00b6030 2024-04-16T12:57:25.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.456+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e00691a0 con 0x7f74e00b6030 2024-04-16T12:57:25.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7fee77fff640 1 -- 172.21.15.106:0/1390836153 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee8007a840 con 0x7fee900b0060 2024-04-16T12:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7f04aaffd640 1 -- 172.21.15.106:0/2192418501 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac040020 con 0x7f04bc14b7d0 2024-04-16T12:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.456+0000 7fa2dffff640 1 -- 172.21.15.106:0/2171317736 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0017070 con 0x7fa2f4071c50 2024-04-16T12:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7fa2dffff640 1 -- 172.21.15.106:0/2171317736 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e000c940 con 0x7fa2f4071c50 2024-04-16T12:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7f5a37fff640 1 -- 172.21.15.106:0/182532904 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a500d3070 con 0x7f5a480365a0 2024-04-16T12:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7fa2dffff640 1 -- 172.21.15.106:0/2171317736 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000ccf0 con 0x7fa2f4071c50 2024-04-16T12:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7f74d5ffb640 1 -- 172.21.15.106:0/2713490354 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74d001a070 con 0x7f74e00b6030 2024-04-16T12:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.458+0000 7f74d5ffb640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c406c9f0 0x7f74c406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.458+0000 7f74d5ffb640 1 -- 172.21.15.106:0/2713490354 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f74d008b980 con 0x7f74e00b6030 2024-04-16T12:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.458+0000 7f74e5656640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c406c9f0 0x7f74c406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04bc146dc0 con 0x7f04bc14b7d0 2024-04-16T12:57:25.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.457+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04bc0b2860 con 0x7f04bc14b7d0 2024-04-16T12:57:25.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.458+0000 7f04aaffd640 1 -- 172.21.15.106:0/2192418501 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac032970 con 0x7f04bc14b7d0 2024-04-16T12:57:25.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.458+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04bc0691a0 con 0x7f04bc14b7d0 2024-04-16T12:57:25.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.458+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f41e1670 con 0x7fa2f4071c50 2024-04-16T12:57:25.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.458+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f4149320 con 0x7fa2f4071c50 2024-04-16T12:57:25.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.459+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f40691a0 con 0x7fa2f4071c50 2024-04-16T12:57:25.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.459+0000 7f74e5656640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c406c9f0 0x7f74c406eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74dc036000 tx=0x7f74dc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.459+0000 7f04aaffd640 1 -- 172.21.15.106:0/2192418501 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac037040 con 0x7f04bc14b7d0 2024-04-16T12:57:25.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.460+0000 7f04aaffd640 1 -- 172.21.15.106:0/2192418501 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04ac043020 con 0x7f04bc14b7d0 2024-04-16T12:57:25.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.460+0000 7f8980ff9640 1 -- 172.21.15.106:0/3418465270 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8978019020 con 0x7f8984145c80 2024-04-16T12:57:25.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.460+0000 7f04aaffd640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f049c06c8f0 0x7f049c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.461+0000 7f04ba59c640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f049c06c8f0 0x7f049c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.461+0000 7f8980ff9640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f897006c940 0x7f897006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.461+0000 7f04aaffd640 1 -- 172.21.15.106:0/2192418501 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f04ac0ad190 con 0x7f04bc14b7d0 2024-04-16T12:57:25.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.461+0000 7f8983fff640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f897006c940 0x7f897006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.461+0000 7f8980ff9640 1 -- 172.21.15.106:0/3418465270 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f897808bbb0 con 0x7f8984145c80 2024-04-16T12:57:25.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.462+0000 7f04ba59c640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f049c06c8f0 0x7f049c06edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f04b40012e0 tx=0x7f04b4001890 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.462+0000 7f8980ff9640 1 -- 172.21.15.106:0/3418465270 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8978020070 con 0x7f8984145c80 2024-04-16T12:57:25.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.462+0000 7f74d5ffb640 1 -- 172.21.15.106:0/2713490354 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74e014f090 con 0x7f74e00b6030 2024-04-16T12:57:25.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.463+0000 7fa2dffff640 1 -- 172.21.15.106:0/2171317736 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2e001a070 con 0x7fa2f4071c50 2024-04-16T12:57:25.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.464+0000 7fa2dffff640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa2d806c940 0x7fa2d806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:25.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.464+0000 7fa2f37fe640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa2d806c940 0x7fa2d806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:25.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.465+0000 7fa2dffff640 1 -- 172.21.15.106:0/2171317736 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa2e0058070 con 0x7fa2f4071c50 2024-04-16T12:57:25.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.465+0000 7fa2f37fe640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa2d806c940 0x7fa2d806ee00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009c00 tx=0x7fa2e8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.463+0000 7f8983fff640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f897006c940 0x7f897006ee00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f897c00a7b0 tx=0x7f897c00d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:25.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.466+0000 7fa2dffff640 1 -- 172.21.15.106:0/2171317736 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2e0059fd0 con 0x7fa2f4071c50 2024-04-16T12:57:25.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.468+0000 7f04aaffd640 1 -- 172.21.15.106:0/2192418501 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f04ac04a030 con 0x7f04bc14b7d0 2024-04-16T12:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.815+0000 7f9fe2d24640 1 -- 172.21.15.106:0/2608601975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9fbc005580 con 0x7f9fdc14d670 2024-04-16T12:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.816+0000 7f9fd97fa640 1 -- 172.21.15.106:0/2608601975 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9fcc07c0a0 con 0x7f9fdc14d670 2024-04-16T12:57:25.817 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2024-04-16T12:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.819+0000 7f9fc2ffd640 1 -- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9fc806c9f0 msgr2=0x7f9fc806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.819+0000 7f9fc2ffd640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9fc806c9f0 0x7f9fc806eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40012e0 tx=0x7f9fd4005b70 comp rx=0 tx=0).stop 2024-04-16T12:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.819+0000 7f9fc2ffd640 1 -- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fdc14d670 msgr2=0x7f9fdc1f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.819+0000 7f9fc2ffd640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fdc14d670 0x7f9fdc1f5e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc032000 tx=0x7f9fcc0046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 -- 172.21.15.106:0/2608601975 shutdown_connections 2024-04-16T12:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9fc806c9f0 0x7f9fc806eeb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fdc14d670 0x7f9fdc1f5e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc09b410 0x7f9fdc14f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 --2- 172.21.15.106:0/2608601975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc06e4c0 0x7f9fdc0b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 -- 172.21.15.106:0/2608601975 >> 172.21.15.106:0/2608601975 conn(0x7f9fdc0ba550 msgr2=0x7f9fdc0b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 -- 172.21.15.106:0/2608601975 shutdown_connections 2024-04-16T12:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.820+0000 7f9fc2ffd640 1 -- 172.21.15.106:0/2608601975 wait complete. 2024-04-16T12:57:25.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-04-16T12:57:25.839 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.851+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f42bc06d220 con 0x7f42bc14cee0 2024-04-16T12:57:25.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.851+0000 7f42a37fe640 1 -- 172.21.15.106:0/1565378449 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42b4010040 con 0x7f42bc14cee0 2024-04-16T12:57:25.853 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2024-04-16T12:57:25.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.853+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42a806c9c0 msgr2=0x7f42a806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.853+0000 7f42c1260640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42a806c9c0 0x7f42a806ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42ac036000 tx=0x7f42ac03c040 comp rx=0 tx=0).stop 2024-04-16T12:57:25.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.853+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42bc14cee0 msgr2=0x7f42bc0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.853+0000 7f42c1260640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42bc14cee0 0x7f42bc0b35a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f42b400eba0 tx=0x7f42b400c490 comp rx=0 tx=0).stop 2024-04-16T12:57:25.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.853+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 shutdown_connections 2024-04-16T12:57:25.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.854+0000 7f42c1260640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42a806c9c0 0x7f42a806ee80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.854+0000 7f42c1260640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42bc14cee0 0x7f42bc0b35a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.854+0000 7f42c1260640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42bc073480 0x7f42bc1e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.854+0000 7f42c1260640 1 --2- 172.21.15.106:0/1565378449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc0679d0 0x7f42bc144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.854+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 >> 172.21.15.106:0/1565378449 conn(0x7f42bc0b6e30 msgr2=0x7f42bc1461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.854+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 shutdown_connections 2024-04-16T12:57:25.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.854+0000 7f42c1260640 1 -- 172.21.15.106:0/1565378449 wait complete. 2024-04-16T12:57:25.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-04-16T12:57:25.866 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.879+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5a48155810 con 0x7f5a480365a0 2024-04-16T12:57:25.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.879+0000 7f5a37fff640 1 -- 172.21.15.106:0/182532904 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a50100410 con 0x7f5a480365a0 2024-04-16T12:57:25.881 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:25.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.881+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fee900b84b0 con 0x7fee900b0060 2024-04-16T12:57:25.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.881+0000 7fee77fff640 1 -- 172.21.15.106:0/1390836153 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fee8007a140 con 0x7fee900b0060 2024-04-16T12:57:25.883 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:25.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5a3c06c9c0 msgr2=0x7f5a3c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5a3c06c9c0 0x7f5a3c06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a44006fd0 tx=0x7f5a44009060 comp rx=0 tx=0).stop 2024-04-16T12:57:25.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a480365a0 msgr2=0x7f5a480cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a480365a0 0x7f5a480cacf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a50000b60 tx=0x7f5a500657c0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 shutdown_connections 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5a3c06c9c0 0x7f5a3c06ee80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a480365a0 0x7f5a480cacf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a480359e0 0x7f5a480bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 --2- 172.21.15.106:0/182532904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a48035600 0x7f5a48154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 >> 172.21.15.106:0/182532904 conn(0x7f5a4803a8a0 msgr2=0x7f5a4803d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 shutdown_connections 2024-04-16T12:57:25.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.883+0000 7f5a35ffb640 1 -- 172.21.15.106:0/182532904 wait complete. 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fee7c06caf0 msgr2=0x7fee7c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fee7c06caf0 0x7fee7c06efb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fee901e2e80 tx=0x7fee84009040 comp rx=0 tx=0).stop 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee900b0060 msgr2=0x7fee90148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee900b0060 0x7fee90148de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee80032000 tx=0x7fee800046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 shutdown_connections 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fee7c06caf0 0x7fee7c06efb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee901e2790 0x7fee90142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee9014c740 0x7fee901e2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 --2- 172.21.15.106:0/1390836153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee900b0060 0x7fee90148de0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.884+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 >> 172.21.15.106:0/1390836153 conn(0x7fee9006c2c0 msgr2=0x7fee900b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.885+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 shutdown_connections 2024-04-16T12:57:25.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.885+0000 7fee94b58640 1 -- 172.21.15.106:0/1390836153 wait complete. 2024-04-16T12:57:25.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.885+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8964005850 con 0x7f8984145c80 2024-04-16T12:57:25.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.885+0000 7f8980ff9640 1 -- 172.21.15.106:0/3418465270 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8978059a00 con 0x7f8984145c80 2024-04-16T12:57:25.889 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:25.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.887+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f74e009e040 con 0x7f74e00b6030 2024-04-16T12:57:25.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f897006c940 msgr2=0x7f897006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f897006c940 0x7f897006ee00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f897c00a7b0 tx=0x7f897c00d040 comp rx=0 tx=0).stop 2024-04-16T12:57:25.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984145c80 msgr2=0x7f8984143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984145c80 0x7f8984143e80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f897800c460 tx=0x7f897800c920 comp rx=0 tx=0).stop 2024-04-16T12:57:25.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f74d5ffb640 1 -- 172.21.15.106:0/2713490354 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74d00597d0 con 0x7f74e00b6030 2024-04-16T12:57:25.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 shutdown_connections 2024-04-16T12:57:25.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f897006c940 0x7f897006ee00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8984154840 0x7f8984133250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984145c80 0x7f8984143e80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 --2- 172.21.15.106:0/3418465270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89840679d0 0x7f8984135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 >> 172.21.15.106:0/3418465270 conn(0x7f89840b63b0 msgr2=0x7f89840b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.891 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:25.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 shutdown_connections 2024-04-16T12:57:25.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.888+0000 7f898a5a8640 1 -- 172.21.15.106:0/3418465270 wait complete. 2024-04-16T12:57:25.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.889+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa2f4149970 con 0x7fa2f4071c50 2024-04-16T12:57:25.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.889+0000 7fa2dffff640 1 -- 172.21.15.106:0/2171317736 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa2e005e2d0 con 0x7fa2f4071c50 2024-04-16T12:57:25.892 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2024-04-16T12:57:25.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.891+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f04bc140810 con 0x7f04bc14b7d0 2024-04-16T12:57:25.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.891+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c406c9f0 msgr2=0x7f74c406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.891+0000 7f74e6658640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c406c9f0 0x7f74c406eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74dc036000 tx=0x7f74dc008030 comp rx=0 tx=0).stop 2024-04-16T12:57:25.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.891+0000 7f04aaffd640 1 -- 172.21.15.106:0/2192418501 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04ac0306e0 con 0x7f04bc14b7d0 2024-04-16T12:57:25.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00b6030 msgr2=0x7f74e0144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00b6030 0x7f74e0144150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f74d000e930 tx=0x7f74d000edf0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.894 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 shutdown_connections 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f74c406c9f0 0x7f74c406eeb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74e00b6030 0x7f74e0144150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74e00727e0 0x7f74e014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 --2- 172.21.15.106:0/2713490354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74e006e900 0x7f74e014fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 >> 172.21.15.106:0/2713490354 conn(0x7f74e009d170 msgr2=0x7f74e006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 shutdown_connections 2024-04-16T12:57:25.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.892+0000 7f74e6658640 1 -- 172.21.15.106:0/2713490354 wait complete. 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa2d806c940 msgr2=0x7fa2d806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa2d806c940 0x7fa2d806ee00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009c00 tx=0x7fa2e8009190 comp rx=0 tx=0).stop 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4071c50 msgr2=0x7fa2f41e1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4071c50 0x7fa2f41e1e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e8a0 tx=0x7fa2e000ed60 comp rx=0 tx=0).stop 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 shutdown_connections 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa2d806c940 0x7fa2d806ee00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2f4146130 0x7fa2f413bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2f4071c50 0x7fa2f41e1e50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 --2- 172.21.15.106:0/2171317736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f406bef0 0x7fa2f414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 >> 172.21.15.106:0/2171317736 conn(0x7fa2f40ba310 msgr2=0x7fa2f4143fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 shutdown_connections 2024-04-16T12:57:25.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.893+0000 7fa2f9eba640 1 -- 172.21.15.106:0/2171317736 wait complete. 2024-04-16T12:57:25.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f049c06c8f0 msgr2=0x7f049c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f049c06c8f0 0x7f049c06edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f04b40012e0 tx=0x7f04b4001890 comp rx=0 tx=0).stop 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04bc14b7d0 msgr2=0x7f04bc13de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04bc14b7d0 0x7f04bc13de70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04ac032000 tx=0x7f04ac0046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 shutdown_connections 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f049c06c8f0 0x7f049c06edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04bc14b7d0 0x7f04bc13de70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04bc14b390 0x7f04bc13d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 --2- 172.21.15.106:0/2192418501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04bc0bdfa0 0x7f04bc0ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.895+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 >> 172.21.15.106:0/2192418501 conn(0x7f04bc067dc0 msgr2=0x7f04bc140ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.896+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 shutdown_connections 2024-04-16T12:57:25.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:25.896+0000 7f04c09d5640 1 -- 172.21.15.106:0/2192418501 wait complete. 2024-04-16T12:57:25.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-04-16T12:57:25.902 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-16T12:57:25.903 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-16T12:57:25.912 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-16T12:57:25.914 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-04-16T12:57:25.914 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-04-16T12:57:25.916 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:25.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T12:57:25.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:57:26.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.057+0000 7f47ea9ba640 1 Processor -- start 2024-04-16T12:57:26.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.057+0000 7f47ea9ba640 1 -- start start 2024-04-16T12:57:26.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47ea9ba640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47e40bbc60 0x7f47e40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47ea9ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bc040 0x7f47e4152830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47ea9ba640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e4073ec0 con 0x7f47e406e650 2024-04-16T12:57:26.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47ea9ba640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f47e40b7580 con 0x7f47e40bbc60 2024-04-16T12:57:26.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47ea9ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f47e4073a10 con 0x7f47e40bc040 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47e8f57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bc040 0x7f47e4152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47e3fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47e40bbc60 0x7f47e40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47e37fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f47e406e650 0x7f47e414bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33658/0 (socket says 172.21.15.106:33658) 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47e8f57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bc040 0x7f47e4152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46326/0 (socket says 172.21.15.106:46326) 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47e37fe640 1 -- 172.21.15.106:0/1718427332 learned_addr learned my addr 172.21.15.106:0/1718427332 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47e2ffd640 1 -- 172.21.15.106:0/1718427332 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014099539 0 0) 0x7f47e4073ec0 con 0x7f47e406e650 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.058+0000 7f47e2ffd640 1 -- 172.21.15.106:0/1718427332 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47cc003520 con 0x7f47e406e650 2024-04-16T12:57:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.059+0000 7f47e8f57640 1 -- 172.21.15.106:0/1718427332 >> v2:172.21.15.171:3300/0 conn(0x7f47e40bbc60 msgr2=0x7f47e40b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.059+0000 7f47e8f57640 1 --2- 172.21.15.106:0/1718427332 >> v2:172.21.15.171:3300/0 conn(0x7f47e40bbc60 0x7f47e40b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.059+0000 7f47e8f57640 1 -- 172.21.15.106:0/1718427332 >> v1:172.21.15.171:6789/0 conn(0x7f47e406e650 legacy=0x7f47e414bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.059+0000 7f47e8f57640 1 -- 172.21.15.106:0/1718427332 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e4072bd0 con 0x7f47e40bc040 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.059+0000 7f47e3fff640 1 --2- 172.21.15.106:0/1718427332 >> v2:172.21.15.171:3300/0 conn(0x7f47e40bbc60 0x7f47e40b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.059+0000 7f47e8f57640 1 --2- 172.21.15.106:0/1718427332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bc040 0x7f47e4152830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d90 tx=0x7f47dc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc99a421a3a773c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47e2ffd640 1 -- 172.21.15.106:0/1718427332 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc039070 con 0x7f47e40bc040 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47e2ffd640 1 -- 172.21.15.106:0/1718427332 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc02cbc0 con 0x7f47e40bc040 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47e2ffd640 1 -- 172.21.15.106:0/1718427332 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc034440 con 0x7f47e40bc040 2024-04-16T12:57:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 -- 172.21.15.106:0/1718427332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bc040 msgr2=0x7f47e4152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/1718427332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bc040 0x7f47e4152830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d90 tx=0x7f47dc02be10 comp rx=0 tx=0).stop 2024-04-16T12:57:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 -- 172.21.15.106:0/1718427332 shutdown_connections 2024-04-16T12:57:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/1718427332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bc040 0x7f47e4152830 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/1718427332 >> v2:172.21.15.171:3300/0 conn(0x7f47e40bbc60 0x7f47e40b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 -- 172.21.15.106:0/1718427332 >> 172.21.15.106:0/1718427332 conn(0x7f47e4067e20 msgr2=0x7f47e40bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 -- 172.21.15.106:0/1718427332 shutdown_connections 2024-04-16T12:57:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.060+0000 7f47ea9ba640 1 -- 172.21.15.106:0/1718427332 wait complete. 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.061+0000 7f47ea9ba640 1 Processor -- start 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.061+0000 7f47ea9ba640 1 -- start start 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47ea9ba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e406e650 0x7f47e41ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47ea9ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bbc60 0x7f47e40b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47ea9ba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40bc040 0x7f47e40b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47ea9ba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f47e414c300 con 0x7f47e406e650 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47ea9ba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47e40b6620 con 0x7f47e40bc040 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47ea9ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f47e414b500 con 0x7f47e40bbc60 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e406e650 0x7f47e41ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e406e650 0x7f47e41ddfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42966/0 (socket says 172.21.15.106:42966) 2024-04-16T12:57:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 -- 172.21.15.106:0/3383090076 learned_addr learned my addr 172.21.15.106:0/3383090076 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e37fe640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bbc60 0x7f47e40b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 -- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bbc60 msgr2=0x7f47e40b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e8f57640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40bc040 0x7f47e40b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bbc60 0x7f47e40b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 -- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40bc040 msgr2=0x7f47e40b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40bc040 0x7f47e40b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 -- 172.21.15.106:0/3383090076 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e413d900 con 0x7f47e406e650 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e3fff640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e406e650 0x7f47e41ddfe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f47d400ebe0 tx=0x7f47d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e0ff9640 1 -- 172.21.15.106:0/3383090076 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4017070 con 0x7f47e406e650 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.062+0000 7f47e0ff9640 1 -- 172.21.15.106:0/3383090076 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d400cc30 con 0x7f47e406e650 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.063+0000 7f47e0ff9640 1 -- 172.21.15.106:0/3383090076 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4013470 con 0x7f47e406e650 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.063+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e40af540 con 0x7f47e406e650 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.063+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e40af260 con 0x7f47e406e650 2024-04-16T12:57:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.063+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e4149a10 con 0x7f47e406e650 2024-04-16T12:57:26.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.064+0000 7f47e0ff9640 1 -- 172.21.15.106:0/3383090076 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f47d401a070 con 0x7f47e406e650 2024-04-16T12:57:26.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.064+0000 7f47e0ff9640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f47d006c920 0x7f47d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.065+0000 7f47e0ff9640 1 -- 172.21.15.106:0/3383090076 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47d408bd70 con 0x7f47e406e650 2024-04-16T12:57:26.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.065+0000 7f47e37fe640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f47d006c920 0x7f47d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.065+0000 7f47e37fe640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f47d006c920 0x7f47d006ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47e4149c60 tx=0x7f47d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.069+0000 7f47e0ff9640 1 -- 172.21.15.106:0/3383090076 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47e4149a10 con 0x7f47e406e650 2024-04-16T12:57:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.241+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47e4068a90 con 0x7f47d006c920 2024-04-16T12:57:26.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.247+0000 7f47e0ff9640 1 -- 172.21.15.106:0/3383090076 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f47e4068a90 con 0x7f47d006c920 2024-04-16T12:57:26.252 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f47d006c920 msgr2=0x7f47d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f47d006c920 0x7f47d006ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47e4149c60 tx=0x7f47d8009040 comp rx=0 tx=0).stop 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e406e650 msgr2=0x7f47e41ddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e406e650 0x7f47e41ddfe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f47d400ebe0 tx=0x7f47d400c520 comp rx=0 tx=0).stop 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 shutdown_connections 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f47d006c920 0x7f47d006ede0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40bc040 0x7f47e40b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40bbc60 0x7f47e40b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 --2- 172.21.15.106:0/3383090076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e406e650 0x7f47e41ddfe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 >> 172.21.15.106:0/3383090076 conn(0x7f47e4067e20 msgr2=0x7f47e4149300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 shutdown_connections 2024-04-16T12:57:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.250+0000 7f47ea9ba640 1 -- 172.21.15.106:0/3383090076 wait complete. 2024-04-16T12:57:26.263 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-16T12:57:26.167339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001529"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897555+0000","last_change":"2024-04-16T12:57:18.894988+0000","last_active":"2024-04-16T12:57:19.897555+0000","last_peered":"2024-04-16T12:57:19.897555+0000","last_clean":"2024-04-16T12:57:19.897555+0000","last_became_active":"2024-04-16T12:57:18.894707+0000","last_became_peered":"2024-04-16T12:57:18.894707+0000","last_unstale":"2024-04-16T12:57:19.897555+0000","last_undegraded":"2024-04-16T12:57:19.897555+0000","last_fullsized":"2024-04-16T12:57:19.897555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:19.298247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895563+0000","last_change":"2024-04-16T12:57:18.906652+0000","last_active":"2024-04-16T12:57:19.895563+0000","last_peered":"2024-04-16T12:57:19.895563+0000","last_clean":"2024-04-16T12:57:19.895563+0000","last_became_active":"2024-04-16T12:57:18.906392+0000","last_became_peered":"2024-04-16T12:57:18.906392+0000","last_unstale":"2024-04-16T12:57:19.895563+0000","last_undegraded":"2024-04-16T12:57:19.895563+0000","last_fullsized":"2024-04-16T12:57:19.895563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997603+0000","last_change":"2024-04-16T12:57:18.900639+0000","last_active":"2024-04-16T12:57:19.997603+0000","last_peered":"2024-04-16T12:57:19.997603+0000","last_clean":"2024-04-16T12:57:19.997603+0000","last_became_active":"2024-04-16T12:57:18.900378+0000","last_became_peered":"2024-04-16T12:57:18.900378+0000","last_unstale":"2024-04-16T12:57:19.997603+0000","last_undegraded":"2024-04-16T12:57:19.997603+0000","last_fullsized":"2024-04-16T12:57:19.997603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896269+0000","last_change":"2024-04-16T12:57:18.907839+0000","last_active":"2024-04-16T12:57:19.896269+0000","last_peered":"2024-04-16T12:57:19.896269+0000","last_clean":"2024-04-16T12:57:19.896269+0000","last_became_active":"2024-04-16T12:57:18.907578+0000","last_became_peered":"2024-04-16T12:57:18.907578+0000","last_unstale":"2024-04-16T12:57:19.896269+0000","last_undegraded":"2024-04-16T12:57:19.896269+0000","last_fullsized":"2024-04-16T12:57:19.896269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896746+0000","last_change":"2024-04-16T12:57:18.893375+0000","last_active":"2024-04-16T12:57:19.896746+0000","last_peered":"2024-04-16T12:57:19.896746+0000","last_clean":"2024-04-16T12:57:19.896746+0000","last_became_active":"2024-04-16T12:57:18.893078+0000","last_became_peered":"2024-04-16T12:57:18.893078+0000","last_unstale":"2024-04-16T12:57:19.896746+0000","last_undegraded":"2024-04-16T12:57:19.896746+0000","last_fullsized":"2024-04-16T12:57:19.896746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896621+0000","last_change":"2024-04-16T12:57:18.896791+0000","last_active":"2024-04-16T12:57:19.896621+0000","last_peered":"2024-04-16T12:57:19.896621+0000","last_clean":"2024-04-16T12:57:19.896621+0000","last_became_active":"2024-04-16T12:57:18.896523+0000","last_became_peered":"2024-04-16T12:57:18.896523+0000","last_unstale":"2024-04-16T12:57:19.896621+0000","last_undegraded":"2024-04-16T12:57:19.896621+0000","last_fullsized":"2024-04-16T12:57:19.896621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:19.298247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895721+0000","last_change":"2024-04-16T12:57:18.897907+0000","last_active":"2024-04-16T12:57:19.895721+0000","last_peered":"2024-04-16T12:57:19.895721+0000","last_clean":"2024-04-16T12:57:19.895721+0000","last_became_active":"2024-04-16T12:57:18.897588+0000","last_became_peered":"2024-04-16T12:57:18.897588+0000","last_unstale":"2024-04-16T12:57:19.895721+0000","last_undegraded":"2024-04-16T12:57:19.895721+0000","last_fullsized":"2024-04-16T12:57:19.895721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223066+0000","last_change":"2024-04-16T12:57:18.907306+0000","last_active":"2024-04-16T12:57:20.223066+0000","last_peered":"2024-04-16T12:57:20.223066+0000","last_clean":"2024-04-16T12:57:20.223066+0000","last_became_active":"2024-04-16T12:57:18.906414+0000","last_became_peered":"2024-04-16T12:57:18.906414+0000","last_unstale":"2024-04-16T12:57:20.223066+0000","last_undegraded":"2024-04-16T12:57:20.223066+0000","last_fullsized":"2024-04-16T12:57:20.223066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897560+0000","last_change":"2024-04-16T12:57:18.897054+0000","last_active":"2024-04-16T12:57:19.897560+0000","last_peered":"2024-04-16T12:57:19.897560+0000","last_clean":"2024-04-16T12:57:19.897560+0000","last_became_active":"2024-04-16T12:57:18.896790+0000","last_became_peered":"2024-04-16T12:57:18.896790+0000","last_unstale":"2024-04-16T12:57:19.897560+0000","last_undegraded":"2024-04-16T12:57:19.897560+0000","last_fullsized":"2024-04-16T12:57:19.897560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:40:52.405695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900534+0000","last_change":"2024-04-16T12:57:18.904093+0000","last_active":"2024-04-16T12:57:19.900534+0000","last_peered":"2024-04-16T12:57:19.900534+0000","last_clean":"2024-04-16T12:57:19.900534+0000","last_became_active":"2024-04-16T12:57:18.903830+0000","last_became_peered":"2024-04-16T12:57:18.903830+0000","last_unstale":"2024-04-16T12:57:19.900534+0000","last_undegraded":"2024-04-16T12:57:19.900534+0000","last_fullsized":"2024-04-16T12:57:19.900534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900379+0000","last_change":"2024-04-16T12:57:18.906220+0000","last_active":"2024-04-16T12:57:19.900379+0000","last_peered":"2024-04-16T12:57:19.900379+0000","last_clean":"2024-04-16T12:57:19.900379+0000","last_became_active":"2024-04-16T12:57:18.905952+0000","last_became_peered":"2024-04-16T12:57:18.905952+0000","last_unstale":"2024-04-16T12:57:19.900379+0000","last_undegraded":"2024-04-16T12:57:19.900379+0000","last_fullsized":"2024-04-16T12:57:19.900379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223666+0000","last_change":"2024-04-16T12:57:18.903800+0000","last_active":"2024-04-16T12:57:20.223666+0000","last_peered":"2024-04-16T12:57:20.223666+0000","last_clean":"2024-04-16T12:57:20.223666+0000","last_became_active":"2024-04-16T12:57:18.903405+0000","last_became_peered":"2024-04-16T12:57:18.903405+0000","last_unstale":"2024-04-16T12:57:20.223666+0000","last_undegraded":"2024-04-16T12:57:20.223666+0000","last_fullsized":"2024-04-16T12:57:20.223666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:57.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223545+0000","last_change":"2024-04-16T12:57:18.907729+0000","last_active":"2024-04-16T12:57:20.223545+0000","last_peered":"2024-04-16T12:57:20.223545+0000","last_clean":"2024-04-16T12:57:20.223545+0000","last_became_active":"2024-04-16T12:57:18.907443+0000","last_became_peered":"2024-04-16T12:57:18.907443+0000","last_unstale":"2024-04-16T12:57:20.223545+0000","last_undegraded":"2024-04-16T12:57:20.223545+0000","last_fullsized":"2024-04-16T12:57:20.223545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997595+0000","last_change":"2024-04-16T12:57:18.901384+0000","last_active":"2024-04-16T12:57:19.997595+0000","last_peered":"2024-04-16T12:57:19.997595+0000","last_clean":"2024-04-16T12:57:19.997595+0000","last_became_active":"2024-04-16T12:57:18.900950+0000","last_became_peered":"2024-04-16T12:57:18.900950+0000","last_unstale":"2024-04-16T12:57:19.997595+0000","last_undegraded":"2024-04-16T12:57:19.997595+0000","last_fullsized":"2024-04-16T12:57:19.997595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895404+0000","last_change":"2024-04-16T12:57:18.895285+0000","last_active":"2024-04-16T12:57:19.895404+0000","last_peered":"2024-04-16T12:57:19.895404+0000","last_clean":"2024-04-16T12:57:19.895404+0000","last_became_active":"2024-04-16T12:57:18.895021+0000","last_became_peered":"2024-04-16T12:57:18.895021+0000","last_unstale":"2024-04-16T12:57:19.895404+0000","last_undegraded":"2024-04-16T12:57:19.895404+0000","last_fullsized":"2024-04-16T12:57:19.895404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896228+0000","last_change":"2024-04-16T12:57:18.901159+0000","last_active":"2024-04-16T12:57:19.896228+0000","last_peered":"2024-04-16T12:57:19.896228+0000","last_clean":"2024-04-16T12:57:19.896228+0000","last_became_active":"2024-04-16T12:57:18.899815+0000","last_became_peered":"2024-04-16T12:57:18.899815+0000","last_unstale":"2024-04-16T12:57:19.896228+0000","last_undegraded":"2024-04-16T12:57:19.896228+0000","last_fullsized":"2024-04-16T12:57:19.896228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896069+0000","last_change":"2024-04-16T12:57:18.899890+0000","last_active":"2024-04-16T12:57:19.896069+0000","last_peered":"2024-04-16T12:57:19.896069+0000","last_clean":"2024-04-16T12:57:19.896069+0000","last_became_active":"2024-04-16T12:57:18.899220+0000","last_became_peered":"2024-04-16T12:57:18.899220+0000","last_unstale":"2024-04-16T12:57:19.896069+0000","last_undegraded":"2024-04-16T12:57:19.896069+0000","last_fullsized":"2024-04-16T12:57:19.896069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223149+0000","last_change":"2024-04-16T12:57:18.895161+0000","last_active":"2024-04-16T12:57:20.223149+0000","last_peered":"2024-04-16T12:57:20.223149+0000","last_clean":"2024-04-16T12:57:20.223149+0000","last_became_active":"2024-04-16T12:57:18.894866+0000","last_became_peered":"2024-04-16T12:57:18.894866+0000","last_unstale":"2024-04-16T12:57:20.223149+0000","last_undegraded":"2024-04-16T12:57:20.223149+0000","last_fullsized":"2024-04-16T12:57:20.223149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:57.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897382+0000","last_change":"2024-04-16T12:57:18.896070+0000","last_active":"2024-04-16T12:57:19.897382+0000","last_peered":"2024-04-16T12:57:19.897382+0000","last_clean":"2024-04-16T12:57:19.897382+0000","last_became_active":"2024-04-16T12:57:18.895789+0000","last_became_peered":"2024-04-16T12:57:18.895789+0000","last_unstale":"2024-04-16T12:57:19.897382+0000","last_undegraded":"2024-04-16T12:57:19.897382+0000","last_fullsized":"2024-04-16T12:57:19.897382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:21.800505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900341+0000","last_change":"2024-04-16T12:57:18.902194+0000","last_active":"2024-04-16T12:57:19.900341+0000","last_peered":"2024-04-16T12:57:19.900341+0000","last_clean":"2024-04-16T12:57:19.900341+0000","last_became_active":"2024-04-16T12:57:18.901578+0000","last_became_peered":"2024-04-16T12:57:18.901578+0000","last_unstale":"2024-04-16T12:57:19.900341+0000","last_undegraded":"2024-04-16T12:57:19.900341+0000","last_fullsized":"2024-04-16T12:57:19.900341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997857+0000","last_change":"2024-04-16T12:57:18.904634+0000","last_active":"2024-04-16T12:57:19.997857+0000","last_peered":"2024-04-16T12:57:19.997857+0000","last_clean":"2024-04-16T12:57:19.997857+0000","last_became_active":"2024-04-16T12:57:18.904143+0000","last_became_peered":"2024-04-16T12:57:18.904143+0000","last_unstale":"2024-04-16T12:57:19.997857+0000","last_undegraded":"2024-04-16T12:57:19.997857+0000","last_fullsized":"2024-04-16T12:57:19.997857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896620+0000","last_change":"2024-04-16T12:57:18.902458+0000","last_active":"2024-04-16T12:57:19.896620+0000","last_peered":"2024-04-16T12:57:19.896620+0000","last_clean":"2024-04-16T12:57:19.896620+0000","last_became_active":"2024-04-16T12:57:18.901188+0000","last_became_peered":"2024-04-16T12:57:18.901188+0000","last_unstale":"2024-04-16T12:57:19.896620+0000","last_undegraded":"2024-04-16T12:57:19.896620+0000","last_fullsized":"2024-04-16T12:57:19.896620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:40:52.405695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223334+0000","last_change":"2024-04-16T12:57:18.909655+0000","last_active":"2024-04-16T12:57:20.223334+0000","last_peered":"2024-04-16T12:57:20.223334+0000","last_clean":"2024-04-16T12:57:20.223334+0000","last_became_active":"2024-04-16T12:57:18.909392+0000","last_became_peered":"2024-04-16T12:57:18.909392+0000","last_unstale":"2024-04-16T12:57:20.223334+0000","last_undegraded":"2024-04-16T12:57:20.223334+0000","last_fullsized":"2024-04-16T12:57:20.223334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896552+0000","last_change":"2024-04-16T12:57:18.901325+0000","last_active":"2024-04-16T12:57:19.896552+0000","last_peered":"2024-04-16T12:57:19.896552+0000","last_clean":"2024-04-16T12:57:19.896552+0000","last_became_active":"2024-04-16T12:57:18.900839+0000","last_became_peered":"2024-04-16T12:57:18.900839+0000","last_unstale":"2024-04-16T12:57:19.896552+0000","last_undegraded":"2024-04-16T12:57:19.896552+0000","last_fullsized":"2024-04-16T12:57:19.896552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:21.800505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223740+0000","last_change":"2024-04-16T12:57:18.912510+0000","last_active":"2024-04-16T12:57:20.223740+0000","last_peered":"2024-04-16T12:57:20.223740+0000","last_clean":"2024-04-16T12:57:20.223740+0000","last_became_active":"2024-04-16T12:57:18.912214+0000","last_became_peered":"2024-04-16T12:57:18.912214+0000","last_unstale":"2024-04-16T12:57:20.223740+0000","last_undegraded":"2024-04-16T12:57:20.223740+0000","last_fullsized":"2024-04-16T12:57:20.223740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900599+0000","last_change":"2024-04-16T12:57:18.898047+0000","last_active":"2024-04-16T12:57:19.900599+0000","last_peered":"2024-04-16T12:57:19.900599+0000","last_clean":"2024-04-16T12:57:19.900599+0000","last_became_active":"2024-04-16T12:57:18.897665+0000","last_became_peered":"2024-04-16T12:57:18.897665+0000","last_unstale":"2024-04-16T12:57:19.900599+0000","last_undegraded":"2024-04-16T12:57:19.900599+0000","last_fullsized":"2024-04-16T12:57:19.900599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895472+0000","last_change":"2024-04-16T12:57:18.899681+0000","last_active":"2024-04-16T12:57:19.895472+0000","last_peered":"2024-04-16T12:57:19.895472+0000","last_clean":"2024-04-16T12:57:19.895472+0000","last_became_active":"2024-04-16T12:57:18.899371+0000","last_became_peered":"2024-04-16T12:57:18.899371+0000","last_unstale":"2024-04-16T12:57:19.895472+0000","last_undegraded":"2024-04-16T12:57:19.895472+0000","last_fullsized":"2024-04-16T12:57:19.895472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223764+0000","last_change":"2024-04-16T12:57:18.907309+0000","last_active":"2024-04-16T12:57:20.223764+0000","last_peered":"2024-04-16T12:57:20.223764+0000","last_clean":"2024-04-16T12:57:20.223764+0000","last_became_active":"2024-04-16T12:57:18.906438+0000","last_became_peered":"2024-04-16T12:57:18.906438+0000","last_unstale":"2024-04-16T12:57:20.223764+0000","last_undegraded":"2024-04-16T12:57:20.223764+0000","last_fullsized":"2024-04-16T12:57:20.223764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997593+0000","last_change":"2024-04-16T12:57:18.900069+0000","last_active":"2024-04-16T12:57:19.997593+0000","last_peered":"2024-04-16T12:57:19.997593+0000","last_clean":"2024-04-16T12:57:19.997593+0000","last_became_active":"2024-04-16T12:57:18.899776+0000","last_became_peered":"2024-04-16T12:57:18.899776+0000","last_unstale":"2024-04-16T12:57:19.997593+0000","last_undegraded":"2024-04-16T12:57:19.997593+0000","last_fullsized":"2024-04-16T12:57:19.997593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:05.692833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897104+0000","last_change":"2024-04-16T12:57:18.902474+0000","last_active":"2024-04-16T12:57:19.897104+0000","last_peered":"2024-04-16T12:57:19.897104+0000","last_clean":"2024-04-16T12:57:19.897104+0000","last_became_active":"2024-04-16T12:57:18.902171+0000","last_became_peered":"2024-04-16T12:57:18.902171+0000","last_unstale":"2024-04-16T12:57:19.897104+0000","last_undegraded":"2024-04-16T12:57:19.897104+0000","last_fullsized":"2024-04-16T12:57:19.897104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:49.068626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223228+0000","last_change":"2024-04-16T12:57:18.897371+0000","last_active":"2024-04-16T12:57:20.223228+0000","last_peered":"2024-04-16T12:57:20.223228+0000","last_clean":"2024-04-16T12:57:20.223228+0000","last_became_active":"2024-04-16T12:57:18.897132+0000","last_became_peered":"2024-04-16T12:57:18.897132+0000","last_unstale":"2024-04-16T12:57:20.223228+0000","last_undegraded":"2024-04-16T12:57:20.223228+0000","last_fullsized":"2024-04-16T12:57:20.223228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:46:42.662630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900198+0000","last_change":"2024-04-16T12:57:18.903430+0000","last_active":"2024-04-16T12:57:19.900198+0000","last_peered":"2024-04-16T12:57:19.900198+0000","last_clean":"2024-04-16T12:57:19.900198+0000","last_became_active":"2024-04-16T12:57:18.903167+0000","last_became_peered":"2024-04-16T12:57:18.903167+0000","last_unstale":"2024-04-16T12:57:19.900198+0000","last_undegraded":"2024-04-16T12:57:19.900198+0000","last_fullsized":"2024-04-16T12:57:19.900198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223458+0000","last_change":"2024-04-16T12:57:18.906576+0000","last_active":"2024-04-16T12:57:20.223458+0000","last_peered":"2024-04-16T12:57:20.223458+0000","last_clean":"2024-04-16T12:57:20.223458+0000","last_became_active":"2024-04-16T12:57:18.906321+0000","last_became_peered":"2024-04-16T12:57:18.906321+0000","last_unstale":"2024-04-16T12:57:20.223458+0000","last_undegraded":"2024-04-16T12:57:20.223458+0000","last_fullsized":"2024-04-16T12:57:20.223458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:19.721593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223780+0000","last_change":"2024-04-16T12:57:17.891624+0000","last_active":"2024-04-16T12:57:20.223780+0000","last_peered":"2024-04-16T12:57:20.223780+0000","last_clean":"2024-04-16T12:57:20.223780+0000","last_became_active":"2024-04-16T12:57:17.891348+0000","last_became_peered":"2024-04-16T12:57:17.891348+0000","last_unstale":"2024-04-16T12:57:20.223780+0000","last_undegraded":"2024-04-16T12:57:20.223780+0000","last_fullsized":"2024-04-16T12:57:20.223780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:08.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997737+0000","last_change":"2024-04-16T12:57:18.899842+0000","last_active":"2024-04-16T12:57:19.997737+0000","last_peered":"2024-04-16T12:57:19.997737+0000","last_clean":"2024-04-16T12:57:19.997737+0000","last_became_active":"2024-04-16T12:57:18.899567+0000","last_became_peered":"2024-04-16T12:57:18.899567+0000","last_unstale":"2024-04-16T12:57:19.997737+0000","last_undegraded":"2024-04-16T12:57:19.997737+0000","last_fullsized":"2024-04-16T12:57:19.997737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900224+0000","last_change":"2024-04-16T12:57:17.897716+0000","last_active":"2024-04-16T12:57:19.900224+0000","last_peered":"2024-04-16T12:57:19.900224+0000","last_clean":"2024-04-16T12:57:19.900224+0000","last_became_active":"2024-04-16T12:57:17.897340+0000","last_became_peered":"2024-04-16T12:57:17.897340+0000","last_unstale":"2024-04-16T12:57:19.900224+0000","last_undegraded":"2024-04-16T12:57:19.900224+0000","last_fullsized":"2024-04-16T12:57:19.900224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223387+0000","last_change":"2024-04-16T12:57:17.897950+0000","last_active":"2024-04-16T12:57:20.223387+0000","last_peered":"2024-04-16T12:57:20.223387+0000","last_clean":"2024-04-16T12:57:20.223387+0000","last_became_active":"2024-04-16T12:57:17.897654+0000","last_became_peered":"2024-04-16T12:57:17.897654+0000","last_unstale":"2024-04-16T12:57:20.223387+0000","last_undegraded":"2024-04-16T12:57:20.223387+0000","last_fullsized":"2024-04-16T12:57:20.223387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223239+0000","last_change":"2024-04-16T12:57:18.904139+0000","last_active":"2024-04-16T12:57:20.223239+0000","last_peered":"2024-04-16T12:57:20.223239+0000","last_clean":"2024-04-16T12:57:20.223239+0000","last_became_active":"2024-04-16T12:57:18.903879+0000","last_became_peered":"2024-04-16T12:57:18.903879+0000","last_unstale":"2024-04-16T12:57:20.223239+0000","last_undegraded":"2024-04-16T12:57:20.223239+0000","last_fullsized":"2024-04-16T12:57:20.223239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896409+0000","last_change":"2024-04-16T12:57:17.892280+0000","last_active":"2024-04-16T12:57:19.896409+0000","last_peered":"2024-04-16T12:57:19.896409+0000","last_clean":"2024-04-16T12:57:19.896409+0000","last_became_active":"2024-04-16T12:57:17.891970+0000","last_became_peered":"2024-04-16T12:57:17.891970+0000","last_unstale":"2024-04-16T12:57:19.896409+0000","last_undegraded":"2024-04-16T12:57:19.896409+0000","last_fullsized":"2024-04-16T12:57:19.896409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895378+0000","last_change":"2024-04-16T12:57:18.898579+0000","last_active":"2024-04-16T12:57:19.895378+0000","last_peered":"2024-04-16T12:57:19.895378+0000","last_clean":"2024-04-16T12:57:19.895378+0000","last_became_active":"2024-04-16T12:57:18.898342+0000","last_became_peered":"2024-04-16T12:57:18.898342+0000","last_unstale":"2024-04-16T12:57:19.895378+0000","last_undegraded":"2024-04-16T12:57:19.895378+0000","last_fullsized":"2024-04-16T12:57:19.895378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900530+0000","last_change":"2024-04-16T12:57:17.903930+0000","last_active":"2024-04-16T12:57:19.900530+0000","last_peered":"2024-04-16T12:57:19.900530+0000","last_clean":"2024-04-16T12:57:19.900530+0000","last_became_active":"2024-04-16T12:57:17.903601+0000","last_became_peered":"2024-04-16T12:57:17.903601+0000","last_unstale":"2024-04-16T12:57:19.900530+0000","last_undegraded":"2024-04-16T12:57:19.900530+0000","last_fullsized":"2024-04-16T12:57:19.900530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895926+0000","last_change":"2024-04-16T12:57:18.903250+0000","last_active":"2024-04-16T12:57:19.895926+0000","last_peered":"2024-04-16T12:57:19.895926+0000","last_clean":"2024-04-16T12:57:19.895926+0000","last_became_active":"2024-04-16T12:57:18.897774+0000","last_became_peered":"2024-04-16T12:57:18.897774+0000","last_unstale":"2024-04-16T12:57:19.895926+0000","last_undegraded":"2024-04-16T12:57:19.895926+0000","last_fullsized":"2024-04-16T12:57:19.895926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896048+0000","last_change":"2024-04-16T12:57:17.901204+0000","last_active":"2024-04-16T12:57:19.896048+0000","last_peered":"2024-04-16T12:57:19.896048+0000","last_clean":"2024-04-16T12:57:19.896048+0000","last_became_active":"2024-04-16T12:57:17.900178+0000","last_became_peered":"2024-04-16T12:57:17.900178+0000","last_unstale":"2024-04-16T12:57:19.896048+0000","last_undegraded":"2024-04-16T12:57:19.896048+0000","last_fullsized":"2024-04-16T12:57:19.896048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997681+0000","last_change":"2024-04-16T12:57:18.900906+0000","last_active":"2024-04-16T12:57:19.997681+0000","last_peered":"2024-04-16T12:57:19.997681+0000","last_clean":"2024-04-16T12:57:19.997681+0000","last_became_active":"2024-04-16T12:57:18.896865+0000","last_became_peered":"2024-04-16T12:57:18.896865+0000","last_unstale":"2024-04-16T12:57:19.997681+0000","last_undegraded":"2024-04-16T12:57:19.997681+0000","last_fullsized":"2024-04-16T12:57:19.997681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895655+0000","last_change":"2024-04-16T12:57:17.904087+0000","last_active":"2024-04-16T12:57:19.895655+0000","last_peered":"2024-04-16T12:57:19.895655+0000","last_clean":"2024-04-16T12:57:19.895655+0000","last_became_active":"2024-04-16T12:57:17.903731+0000","last_became_peered":"2024-04-16T12:57:17.903731+0000","last_unstale":"2024-04-16T12:57:19.895655+0000","last_undegraded":"2024-04-16T12:57:19.895655+0000","last_fullsized":"2024-04-16T12:57:19.895655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223665+0000","last_change":"2024-04-16T12:57:18.900730+0000","last_active":"2024-04-16T12:57:20.223665+0000","last_peered":"2024-04-16T12:57:20.223665+0000","last_clean":"2024-04-16T12:57:20.223665+0000","last_became_active":"2024-04-16T12:57:18.899959+0000","last_became_peered":"2024-04-16T12:57:18.899959+0000","last_unstale":"2024-04-16T12:57:20.223665+0000","last_undegraded":"2024-04-16T12:57:20.223665+0000","last_fullsized":"2024-04-16T12:57:20.223665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:46:42.662630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900311+0000","last_change":"2024-04-16T12:57:17.903883+0000","last_active":"2024-04-16T12:57:19.900311+0000","last_peered":"2024-04-16T12:57:19.900311+0000","last_clean":"2024-04-16T12:57:19.900311+0000","last_became_active":"2024-04-16T12:57:17.903572+0000","last_became_peered":"2024-04-16T12:57:17.903572+0000","last_unstale":"2024-04-16T12:57:19.900311+0000","last_undegraded":"2024-04-16T12:57:19.900311+0000","last_fullsized":"2024-04-16T12:57:19.900311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897063+0000","last_change":"2024-04-16T12:57:18.899095+0000","last_active":"2024-04-16T12:57:19.897063+0000","last_peered":"2024-04-16T12:57:19.897063+0000","last_clean":"2024-04-16T12:57:19.897063+0000","last_became_active":"2024-04-16T12:57:18.898825+0000","last_became_peered":"2024-04-16T12:57:18.898825+0000","last_unstale":"2024-04-16T12:57:19.897063+0000","last_undegraded":"2024-04-16T12:57:19.897063+0000","last_fullsized":"2024-04-16T12:57:19.897063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:16.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997825+0000","last_change":"2024-04-16T12:57:17.903777+0000","last_active":"2024-04-16T12:57:19.997825+0000","last_peered":"2024-04-16T12:57:19.997825+0000","last_clean":"2024-04-16T12:57:19.997825+0000","last_became_active":"2024-04-16T12:57:17.903478+0000","last_became_peered":"2024-04-16T12:57:17.903478+0000","last_unstale":"2024-04-16T12:57:19.997825+0000","last_undegraded":"2024-04-16T12:57:19.997825+0000","last_fullsized":"2024-04-16T12:57:19.997825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:57:14.224709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997484+0000","last_change":"2024-04-16T12:57:18.903190+0000","last_active":"2024-04-16T12:57:19.997484+0000","last_peered":"2024-04-16T12:57:19.997484+0000","last_clean":"2024-04-16T12:57:19.997484+0000","last_became_active":"2024-04-16T12:57:18.902934+0000","last_became_peered":"2024-04-16T12:57:18.902934+0000","last_unstale":"2024-04-16T12:57:19.997484+0000","last_undegraded":"2024-04-16T12:57:19.997484+0000","last_fullsized":"2024-04-16T12:57:19.997484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:37.114869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897144+0000","last_change":"2024-04-16T12:57:17.902218+0000","last_active":"2024-04-16T12:57:19.897144+0000","last_peered":"2024-04-16T12:57:19.897144+0000","last_clean":"2024-04-16T12:57:19.897144+0000","last_became_active":"2024-04-16T12:57:17.901896+0000","last_became_peered":"2024-04-16T12:57:17.901896+0000","last_unstale":"2024-04-16T12:57:19.897144+0000","last_undegraded":"2024-04-16T12:57:19.897144+0000","last_fullsized":"2024-04-16T12:57:19.897144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896906+0000","last_change":"2024-04-16T12:57:18.900704+0000","last_active":"2024-04-16T12:57:19.896906+0000","last_peered":"2024-04-16T12:57:19.896906+0000","last_clean":"2024-04-16T12:57:19.896906+0000","last_became_active":"2024-04-16T12:57:18.900420+0000","last_became_peered":"2024-04-16T12:57:18.900420+0000","last_unstale":"2024-04-16T12:57:19.896906+0000","last_undegraded":"2024-04-16T12:57:19.896906+0000","last_fullsized":"2024-04-16T12:57:19.896906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900170+0000","last_change":"2024-04-16T12:57:17.901200+0000","last_active":"2024-04-16T12:57:19.900170+0000","last_peered":"2024-04-16T12:57:19.900170+0000","last_clean":"2024-04-16T12:57:19.900170+0000","last_became_active":"2024-04-16T12:57:17.900900+0000","last_became_peered":"2024-04-16T12:57:17.900900+0000","last_unstale":"2024-04-16T12:57:19.900170+0000","last_undegraded":"2024-04-16T12:57:19.900170+0000","last_fullsized":"2024-04-16T12:57:19.900170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900247+0000","last_change":"2024-04-16T12:57:18.901730+0000","last_active":"2024-04-16T12:57:19.900247+0000","last_peered":"2024-04-16T12:57:19.900247+0000","last_clean":"2024-04-16T12:57:19.900247+0000","last_became_active":"2024-04-16T12:57:18.901341+0000","last_became_peered":"2024-04-16T12:57:18.901341+0000","last_unstale":"2024-04-16T12:57:19.900247+0000","last_undegraded":"2024-04-16T12:57:19.900247+0000","last_fullsized":"2024-04-16T12:57:19.900247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223017+0000","last_change":"2024-04-16T12:57:17.897292+0000","last_active":"2024-04-16T12:57:20.223017+0000","last_peered":"2024-04-16T12:57:20.223017+0000","last_clean":"2024-04-16T12:57:20.223017+0000","last_became_active":"2024-04-16T12:57:17.896999+0000","last_became_peered":"2024-04-16T12:57:17.896999+0000","last_unstale":"2024-04-16T12:57:20.223017+0000","last_undegraded":"2024-04-16T12:57:20.223017+0000","last_fullsized":"2024-04-16T12:57:20.223017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895645+0000","last_change":"2024-04-16T12:57:18.896129+0000","last_active":"2024-04-16T12:57:19.895645+0000","last_peered":"2024-04-16T12:57:19.895645+0000","last_clean":"2024-04-16T12:57:19.895645+0000","last_became_active":"2024-04-16T12:57:18.895812+0000","last_became_peered":"2024-04-16T12:57:18.895812+0000","last_unstale":"2024-04-16T12:57:19.895645+0000","last_undegraded":"2024-04-16T12:57:19.895645+0000","last_fullsized":"2024-04-16T12:57:19.895645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223695+0000","last_change":"2024-04-16T12:57:17.905436+0000","last_active":"2024-04-16T12:57:20.223695+0000","last_peered":"2024-04-16T12:57:20.223695+0000","last_clean":"2024-04-16T12:57:20.223695+0000","last_became_active":"2024-04-16T12:57:17.905189+0000","last_became_peered":"2024-04-16T12:57:17.905189+0000","last_unstale":"2024-04-16T12:57:20.223695+0000","last_undegraded":"2024-04-16T12:57:20.223695+0000","last_fullsized":"2024-04-16T12:57:20.223695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:57:14.224709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896980+0000","last_change":"2024-04-16T12:57:18.893937+0000","last_active":"2024-04-16T12:57:19.896980+0000","last_peered":"2024-04-16T12:57:19.896980+0000","last_clean":"2024-04-16T12:57:19.896980+0000","last_became_active":"2024-04-16T12:57:18.893558+0000","last_became_peered":"2024-04-16T12:57:18.893558+0000","last_unstale":"2024-04-16T12:57:19.896980+0000","last_undegraded":"2024-04-16T12:57:19.896980+0000","last_fullsized":"2024-04-16T12:57:19.896980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223442+0000","last_change":"2024-04-16T12:57:17.896413+0000","last_active":"2024-04-16T12:57:20.223442+0000","last_peered":"2024-04-16T12:57:20.223442+0000","last_clean":"2024-04-16T12:57:20.223442+0000","last_became_active":"2024-04-16T12:57:17.896134+0000","last_became_peered":"2024-04-16T12:57:17.896134+0000","last_unstale":"2024-04-16T12:57:20.223442+0000","last_undegraded":"2024-04-16T12:57:20.223442+0000","last_fullsized":"2024-04-16T12:57:20.223442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897649+0000","last_change":"2024-04-16T12:57:18.896924+0000","last_active":"2024-04-16T12:57:19.897649+0000","last_peered":"2024-04-16T12:57:19.897649+0000","last_clean":"2024-04-16T12:57:19.897649+0000","last_became_active":"2024-04-16T12:57:18.896402+0000","last_became_peered":"2024-04-16T12:57:18.896402+0000","last_unstale":"2024-04-16T12:57:19.897649+0000","last_undegraded":"2024-04-16T12:57:19.897649+0000","last_fullsized":"2024-04-16T12:57:19.897649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:49.068626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895731+0000","last_change":"2024-04-16T12:57:17.898110+0000","last_active":"2024-04-16T12:57:19.895731+0000","last_peered":"2024-04-16T12:57:19.895731+0000","last_clean":"2024-04-16T12:57:19.895731+0000","last_became_active":"2024-04-16T12:57:17.897814+0000","last_became_peered":"2024-04-16T12:57:17.897814+0000","last_unstale":"2024-04-16T12:57:19.895731+0000","last_undegraded":"2024-04-16T12:57:19.895731+0000","last_fullsized":"2024-04-16T12:57:19.895731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896466+0000","last_change":"2024-04-16T12:57:18.907293+0000","last_active":"2024-04-16T12:57:19.896466+0000","last_peered":"2024-04-16T12:57:19.896466+0000","last_clean":"2024-04-16T12:57:19.896466+0000","last_became_active":"2024-04-16T12:57:18.906995+0000","last_became_peered":"2024-04-16T12:57:18.906995+0000","last_unstale":"2024-04-16T12:57:19.896466+0000","last_undegraded":"2024-04-16T12:57:19.896466+0000","last_fullsized":"2024-04-16T12:57:19.896466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.051530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223511+0000","last_change":"2024-04-16T12:57:17.895622+0000","last_active":"2024-04-16T12:57:20.223511+0000","last_peered":"2024-04-16T12:57:20.223511+0000","last_clean":"2024-04-16T12:57:20.223511+0000","last_became_active":"2024-04-16T12:57:17.895299+0000","last_became_peered":"2024-04-16T12:57:17.895299+0000","last_unstale":"2024-04-16T12:57:20.223511+0000","last_undegraded":"2024-04-16T12:57:20.223511+0000","last_fullsized":"2024-04-16T12:57:20.223511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897213+0000","last_change":"2024-04-16T12:57:18.897653+0000","last_active":"2024-04-16T12:57:19.897213+0000","last_peered":"2024-04-16T12:57:19.897213+0000","last_clean":"2024-04-16T12:57:19.897213+0000","last_became_active":"2024-04-16T12:57:18.897367+0000","last_became_peered":"2024-04-16T12:57:18.897367+0000","last_unstale":"2024-04-16T12:57:19.897213+0000","last_undegraded":"2024-04-16T12:57:19.897213+0000","last_fullsized":"2024-04-16T12:57:19.897213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.051530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895537+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:19.895537+0000","last_peered":"2024-04-16T12:57:19.895537+0000","last_clean":"2024-04-16T12:57:19.895537+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:19.895537+0000","last_undegraded":"2024-04-16T12:57:19.895537+0000","last_fullsized":"2024-04-16T12:57:19.895537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895665+0000","last_change":"2024-04-16T12:57:17.902517+0000","last_active":"2024-04-16T12:57:19.895665+0000","last_peered":"2024-04-16T12:57:19.895665+0000","last_clean":"2024-04-16T12:57:19.895665+0000","last_became_active":"2024-04-16T12:57:17.902160+0000","last_became_peered":"2024-04-16T12:57:17.902160+0000","last_unstale":"2024-04-16T12:57:19.895665+0000","last_undegraded":"2024-04-16T12:57:19.895665+0000","last_fullsized":"2024-04-16T12:57:19.895665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223681+0000","last_change":"2024-04-16T12:57:18.906944+0000","last_active":"2024-04-16T12:57:20.223681+0000","last_peered":"2024-04-16T12:57:20.223681+0000","last_clean":"2024-04-16T12:57:20.223681+0000","last_became_active":"2024-04-16T12:57:18.906072+0000","last_became_peered":"2024-04-16T12:57:18.906072+0000","last_unstale":"2024-04-16T12:57:20.223681+0000","last_undegraded":"2024-04-16T12:57:20.223681+0000","last_fullsized":"2024-04-16T12:57:20.223681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895471+0000","last_change":"2024-04-16T12:57:17.898599+0000","last_active":"2024-04-16T12:57:19.895471+0000","last_peered":"2024-04-16T12:57:19.895471+0000","last_clean":"2024-04-16T12:57:19.895471+0000","last_became_active":"2024-04-16T12:57:17.898297+0000","last_became_peered":"2024-04-16T12:57:17.898297+0000","last_unstale":"2024-04-16T12:57:19.895471+0000","last_undegraded":"2024-04-16T12:57:19.895471+0000","last_fullsized":"2024-04-16T12:57:19.895471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997392+0000","last_change":"2024-04-16T12:57:18.900390+0000","last_active":"2024-04-16T12:57:19.997392+0000","last_peered":"2024-04-16T12:57:19.997392+0000","last_clean":"2024-04-16T12:57:19.997392+0000","last_became_active":"2024-04-16T12:57:18.900127+0000","last_became_peered":"2024-04-16T12:57:18.900127+0000","last_unstale":"2024-04-16T12:57:19.997392+0000","last_undegraded":"2024-04-16T12:57:19.997392+0000","last_fullsized":"2024-04-16T12:57:19.997392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:15:47.405509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223323+0000","last_change":"2024-04-16T12:57:17.896418+0000","last_active":"2024-04-16T12:57:20.223323+0000","last_peered":"2024-04-16T12:57:20.223323+0000","last_clean":"2024-04-16T12:57:20.223323+0000","last_became_active":"2024-04-16T12:57:17.896171+0000","last_became_peered":"2024-04-16T12:57:17.896171+0000","last_unstale":"2024-04-16T12:57:20.223323+0000","last_undegraded":"2024-04-16T12:57:20.223323+0000","last_fullsized":"2024-04-16T12:57:20.223323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895348+0000","last_change":"2024-04-16T12:57:18.895902+0000","last_active":"2024-04-16T12:57:19.895348+0000","last_peered":"2024-04-16T12:57:19.895348+0000","last_clean":"2024-04-16T12:57:19.895348+0000","last_became_active":"2024-04-16T12:57:18.895646+0000","last_became_peered":"2024-04-16T12:57:18.895646+0000","last_unstale":"2024-04-16T12:57:19.895348+0000","last_undegraded":"2024-04-16T12:57:19.895348+0000","last_fullsized":"2024-04-16T12:57:19.895348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897213+0000","last_change":"2024-04-16T12:57:17.899456+0000","last_active":"2024-04-16T12:57:19.897213+0000","last_peered":"2024-04-16T12:57:19.897213+0000","last_clean":"2024-04-16T12:57:19.897213+0000","last_became_active":"2024-04-16T12:57:17.898313+0000","last_became_peered":"2024-04-16T12:57:17.898313+0000","last_unstale":"2024-04-16T12:57:19.897213+0000","last_undegraded":"2024-04-16T12:57:19.897213+0000","last_fullsized":"2024-04-16T12:57:19.897213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223517+0000","last_change":"2024-04-16T12:57:18.904379+0000","last_active":"2024-04-16T12:57:20.223517+0000","last_peered":"2024-04-16T12:57:20.223517+0000","last_clean":"2024-04-16T12:57:20.223517+0000","last_became_active":"2024-04-16T12:57:18.904118+0000","last_became_peered":"2024-04-16T12:57:18.904118+0000","last_unstale":"2024-04-16T12:57:20.223517+0000","last_undegraded":"2024-04-16T12:57:20.223517+0000","last_fullsized":"2024-04-16T12:57:20.223517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:03.297461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895700+0000","last_change":"2024-04-16T12:57:17.905541+0000","last_active":"2024-04-16T12:57:19.895700+0000","last_peered":"2024-04-16T12:57:19.895700+0000","last_clean":"2024-04-16T12:57:19.895700+0000","last_became_active":"2024-04-16T12:57:17.905253+0000","last_became_peered":"2024-04-16T12:57:17.905253+0000","last_unstale":"2024-04-16T12:57:19.895700+0000","last_undegraded":"2024-04-16T12:57:19.895700+0000","last_fullsized":"2024-04-16T12:57:19.895700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896326+0000","last_change":"2024-04-16T12:57:18.908431+0000","last_active":"2024-04-16T12:57:19.896326+0000","last_peered":"2024-04-16T12:57:19.896326+0000","last_clean":"2024-04-16T12:57:19.896326+0000","last_became_active":"2024-04-16T12:57:18.908069+0000","last_became_peered":"2024-04-16T12:57:18.908069+0000","last_unstale":"2024-04-16T12:57:19.896326+0000","last_undegraded":"2024-04-16T12:57:19.896326+0000","last_fullsized":"2024-04-16T12:57:19.896326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897403+0000","last_change":"2024-04-16T12:57:17.902749+0000","last_active":"2024-04-16T12:57:19.897403+0000","last_peered":"2024-04-16T12:57:19.897403+0000","last_clean":"2024-04-16T12:57:19.897403+0000","last_became_active":"2024-04-16T12:57:17.902368+0000","last_became_peered":"2024-04-16T12:57:17.902368+0000","last_unstale":"2024-04-16T12:57:19.897403+0000","last_undegraded":"2024-04-16T12:57:19.897403+0000","last_fullsized":"2024-04-16T12:57:19.897403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:55.997554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895628+0000","last_change":"2024-04-16T12:57:18.897877+0000","last_active":"2024-04-16T12:57:19.895628+0000","last_peered":"2024-04-16T12:57:19.895628+0000","last_clean":"2024-04-16T12:57:19.895628+0000","last_became_active":"2024-04-16T12:57:18.897246+0000","last_became_peered":"2024-04-16T12:57:18.897246+0000","last_unstale":"2024-04-16T12:57:19.895628+0000","last_undegraded":"2024-04-16T12:57:19.895628+0000","last_fullsized":"2024-04-16T12:57:19.895628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.899642+0000","last_change":"2024-04-16T12:57:17.894217+0000","last_active":"2024-04-16T12:57:19.899642+0000","last_peered":"2024-04-16T12:57:19.899642+0000","last_clean":"2024-04-16T12:57:19.899642+0000","last_became_active":"2024-04-16T12:57:17.893946+0000","last_became_peered":"2024-04-16T12:57:17.893946+0000","last_unstale":"2024-04-16T12:57:19.899642+0000","last_undegraded":"2024-04-16T12:57:19.899642+0000","last_fullsized":"2024-04-16T12:57:19.899642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:02.292438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223783+0000","last_change":"2024-04-16T12:57:18.898378+0000","last_active":"2024-04-16T12:57:20.223783+0000","last_peered":"2024-04-16T12:57:20.223783+0000","last_clean":"2024-04-16T12:57:20.223783+0000","last_became_active":"2024-04-16T12:57:18.898091+0000","last_became_peered":"2024-04-16T12:57:18.898091+0000","last_unstale":"2024-04-16T12:57:20.223783+0000","last_undegraded":"2024-04-16T12:57:20.223783+0000","last_fullsized":"2024-04-16T12:57:20.223783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900585+0000","last_change":"2024-04-16T12:57:17.897818+0000","last_active":"2024-04-16T12:57:19.900585+0000","last_peered":"2024-04-16T12:57:19.900585+0000","last_clean":"2024-04-16T12:57:19.900585+0000","last_became_active":"2024-04-16T12:57:17.897513+0000","last_became_peered":"2024-04-16T12:57:17.897513+0000","last_unstale":"2024-04-16T12:57:19.900585+0000","last_undegraded":"2024-04-16T12:57:19.900585+0000","last_fullsized":"2024-04-16T12:57:19.900585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997652+0000","last_change":"2024-04-16T12:57:18.902147+0000","last_active":"2024-04-16T12:57:19.997652+0000","last_peered":"2024-04-16T12:57:19.997652+0000","last_clean":"2024-04-16T12:57:19.997652+0000","last_became_active":"2024-04-16T12:57:18.901853+0000","last_became_peered":"2024-04-16T12:57:18.901853+0000","last_unstale":"2024-04-16T12:57:19.997652+0000","last_undegraded":"2024-04-16T12:57:19.997652+0000","last_fullsized":"2024-04-16T12:57:19.997652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895498+0000","last_change":"2024-04-16T12:57:17.905371+0000","last_active":"2024-04-16T12:57:19.895498+0000","last_peered":"2024-04-16T12:57:19.895498+0000","last_clean":"2024-04-16T12:57:19.895498+0000","last_became_active":"2024-04-16T12:57:17.905116+0000","last_became_peered":"2024-04-16T12:57:17.905116+0000","last_unstale":"2024-04-16T12:57:19.895498+0000","last_undegraded":"2024-04-16T12:57:19.895498+0000","last_fullsized":"2024-04-16T12:57:19.895498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223378+0000","last_change":"2024-04-16T12:57:18.897144+0000","last_active":"2024-04-16T12:57:20.223378+0000","last_peered":"2024-04-16T12:57:20.223378+0000","last_clean":"2024-04-16T12:57:20.223378+0000","last_became_active":"2024-04-16T12:57:18.896856+0000","last_became_peered":"2024-04-16T12:57:18.896856+0000","last_unstale":"2024-04-16T12:57:20.223378+0000","last_undegraded":"2024-04-16T12:57:20.223378+0000","last_fullsized":"2024-04-16T12:57:20.223378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:55.085085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895467+0000","last_change":"2024-04-16T12:57:17.900711+0000","last_active":"2024-04-16T12:57:19.895467+0000","last_peered":"2024-04-16T12:57:19.895467+0000","last_clean":"2024-04-16T12:57:19.895467+0000","last_became_active":"2024-04-16T12:57:17.900310+0000","last_became_peered":"2024-04-16T12:57:17.900310+0000","last_unstale":"2024-04-16T12:57:19.895467+0000","last_undegraded":"2024-04-16T12:57:19.895467+0000","last_fullsized":"2024-04-16T12:57:19.895467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223267+0000","last_change":"2024-04-16T12:57:18.902887+0000","last_active":"2024-04-16T12:57:20.223267+0000","last_peered":"2024-04-16T12:57:20.223267+0000","last_clean":"2024-04-16T12:57:20.223267+0000","last_became_active":"2024-04-16T12:57:18.902472+0000","last_became_peered":"2024-04-16T12:57:18.902472+0000","last_unstale":"2024-04-16T12:57:20.223267+0000","last_undegraded":"2024-04-16T12:57:20.223267+0000","last_fullsized":"2024-04-16T12:57:20.223267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895602+0000","last_change":"2024-04-16T12:57:17.898164+0000","last_active":"2024-04-16T12:57:19.895602+0000","last_peered":"2024-04-16T12:57:19.895602+0000","last_clean":"2024-04-16T12:57:19.895602+0000","last_became_active":"2024-04-16T12:57:17.897830+0000","last_became_peered":"2024-04-16T12:57:17.897830+0000","last_unstale":"2024-04-16T12:57:19.895602+0000","last_undegraded":"2024-04-16T12:57:19.895602+0000","last_fullsized":"2024-04-16T12:57:19.895602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223680+0000","last_change":"2024-04-16T12:57:18.907229+0000","last_active":"2024-04-16T12:57:20.223680+0000","last_peered":"2024-04-16T12:57:20.223680+0000","last_clean":"2024-04-16T12:57:20.223680+0000","last_became_active":"2024-04-16T12:57:18.906470+0000","last_became_peered":"2024-04-16T12:57:18.906470+0000","last_unstale":"2024-04-16T12:57:20.223680+0000","last_undegraded":"2024-04-16T12:57:20.223680+0000","last_fullsized":"2024-04-16T12:57:20.223680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897038+0000","last_change":"2024-04-16T12:57:17.899164+0000","last_active":"2024-04-16T12:57:19.897038+0000","last_peered":"2024-04-16T12:57:19.897038+0000","last_clean":"2024-04-16T12:57:19.897038+0000","last_became_active":"2024-04-16T12:57:17.898085+0000","last_became_peered":"2024-04-16T12:57:17.898085+0000","last_unstale":"2024-04-16T12:57:19.897038+0000","last_undegraded":"2024-04-16T12:57:19.897038+0000","last_fullsized":"2024-04-16T12:57:19.897038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900405+0000","last_change":"2024-04-16T12:57:18.902652+0000","last_active":"2024-04-16T12:57:19.900405+0000","last_peered":"2024-04-16T12:57:19.900405+0000","last_clean":"2024-04-16T12:57:19.900405+0000","last_became_active":"2024-04-16T12:57:18.902392+0000","last_became_peered":"2024-04-16T12:57:18.902392+0000","last_unstale":"2024-04-16T12:57:19.900405+0000","last_undegraded":"2024-04-16T12:57:19.900405+0000","last_fullsized":"2024-04-16T12:57:19.900405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896213+0000","last_change":"2024-04-16T12:57:18.898290+0000","last_active":"2024-04-16T12:57:19.896213+0000","last_peered":"2024-04-16T12:57:19.896213+0000","last_clean":"2024-04-16T12:57:19.896213+0000","last_became_active":"2024-04-16T12:57:18.897987+0000","last_became_peered":"2024-04-16T12:57:18.897987+0000","last_unstale":"2024-04-16T12:57:19.896213+0000","last_undegraded":"2024-04-16T12:57:19.896213+0000","last_fullsized":"2024-04-16T12:57:19.896213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897011+0000","last_change":"2024-04-16T12:57:17.897406+0000","last_active":"2024-04-16T12:57:19.897011+0000","last_peered":"2024-04-16T12:57:19.897011+0000","last_clean":"2024-04-16T12:57:19.897011+0000","last_became_active":"2024-04-16T12:57:17.897092+0000","last_became_peered":"2024-04-16T12:57:17.897092+0000","last_unstale":"2024-04-16T12:57:19.897011+0000","last_undegraded":"2024-04-16T12:57:19.897011+0000","last_fullsized":"2024-04-16T12:57:19.897011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896453+0000","last_change":"2024-04-16T12:57:18.898875+0000","last_active":"2024-04-16T12:57:19.896453+0000","last_peered":"2024-04-16T12:57:19.896453+0000","last_clean":"2024-04-16T12:57:19.896453+0000","last_became_active":"2024-04-16T12:57:18.898620+0000","last_became_peered":"2024-04-16T12:57:18.898620+0000","last_unstale":"2024-04-16T12:57:19.896453+0000","last_undegraded":"2024-04-16T12:57:19.896453+0000","last_fullsized":"2024-04-16T12:57:19.896453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:16.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897291+0000","last_change":"2024-04-16T12:57:17.893648+0000","last_active":"2024-04-16T12:57:19.897291+0000","last_peered":"2024-04-16T12:57:19.897291+0000","last_clean":"2024-04-16T12:57:19.897291+0000","last_became_active":"2024-04-16T12:57:17.893177+0000","last_became_peered":"2024-04-16T12:57:17.893177+0000","last_unstale":"2024-04-16T12:57:19.897291+0000","last_undegraded":"2024-04-16T12:57:19.897291+0000","last_fullsized":"2024-04-16T12:57:19.897291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:02.292438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997690+0000","last_change":"2024-04-16T12:57:18.897038+0000","last_active":"2024-04-16T12:57:19.997690+0000","last_peered":"2024-04-16T12:57:19.997690+0000","last_clean":"2024-04-16T12:57:19.997690+0000","last_became_active":"2024-04-16T12:57:18.896693+0000","last_became_peered":"2024-04-16T12:57:18.896693+0000","last_unstale":"2024-04-16T12:57:19.997690+0000","last_undegraded":"2024-04-16T12:57:19.997690+0000","last_fullsized":"2024-04-16T12:57:19.997690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223881+0000","last_change":"2024-04-16T12:57:17.905286+0000","last_active":"2024-04-16T12:57:20.223881+0000","last_peered":"2024-04-16T12:57:20.223881+0000","last_clean":"2024-04-16T12:57:20.223881+0000","last_became_active":"2024-04-16T12:57:17.904988+0000","last_became_peered":"2024-04-16T12:57:17.904988+0000","last_unstale":"2024-04-16T12:57:20.223881+0000","last_undegraded":"2024-04-16T12:57:20.223881+0000","last_fullsized":"2024-04-16T12:57:20.223881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:44.138685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223821+0000","last_change":"2024-04-16T12:57:18.905616+0000","last_active":"2024-04-16T12:57:20.223821+0000","last_peered":"2024-04-16T12:57:20.223821+0000","last_clean":"2024-04-16T12:57:20.223821+0000","last_became_active":"2024-04-16T12:57:18.905328+0000","last_became_peered":"2024-04-16T12:57:18.905328+0000","last_unstale":"2024-04-16T12:57:20.223821+0000","last_undegraded":"2024-04-16T12:57:20.223821+0000","last_fullsized":"2024-04-16T12:57:20.223821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997793+0000","last_change":"2024-04-16T12:57:17.902362+0000","last_active":"2024-04-16T12:57:19.997793+0000","last_peered":"2024-04-16T12:57:19.997793+0000","last_clean":"2024-04-16T12:57:19.997793+0000","last_became_active":"2024-04-16T12:57:17.902091+0000","last_became_peered":"2024-04-16T12:57:17.902091+0000","last_unstale":"2024-04-16T12:57:19.997793+0000","last_undegraded":"2024-04-16T12:57:19.997793+0000","last_fullsized":"2024-04-16T12:57:19.997793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:44.138685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:57:26.267 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:57:26.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.404+0000 7f416b40d640 1 Processor -- start 2024-04-16T12:57:26.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.404+0000 7f416b40d640 1 -- start start 2024-04-16T12:57:26.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f416b40d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f41640b2970 0x7f416413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f416b40d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41640b3a80 con 0x7f416413fef0 2024-04-16T12:57:26.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f416b40d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41640bc200 con 0x7f41640bbe20 2024-04-16T12:57:26.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f416b40d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f41641497d0 con 0x7f41640b2970 2024-04-16T12:57:26.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f41689a8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f41640b2970 0x7f416413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f41689a8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f41640b2970 0x7f416413f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42976/0 (socket says 172.21.15.106:42976) 2024-04-16T12:57:26.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f41689a8640 1 -- 172.21.15.106:0/3198293219 learned_addr learned my addr 172.21.15.106:0/3198293219 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:26.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f41689a8640 1 -- 172.21.15.106:0/3198293219 >> v1:172.21.15.171:6789/0 conn(0x7f41640bbe20 legacy=0x7f41641490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f41689a8640 1 -- 172.21.15.106:0/3198293219 >> v1:172.21.15.106:6789/0 conn(0x7f416413fef0 legacy=0x7f4164150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f41689a8640 1 -- 172.21.15.106:0/3198293219 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41640b7cb0 con 0x7f41640b2970 2024-04-16T12:57:26.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.405+0000 7f415bfff640 1 -- 172.21.15.106:0/3198293219 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961172656 0 0) 0x7f41640b3a80 con 0x7f416413fef0 2024-04-16T12:57:26.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.406+0000 7f41689a8640 1 --2- 172.21.15.106:0/3198293219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640b2970 0x7f416413f9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4154009870 tx=0x7f415402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39b30ad34c74e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.406+0000 7f415bfff640 1 -- 172.21.15.106:0/3198293219 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154034070 con 0x7f41640b2970 2024-04-16T12:57:26.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.406+0000 7f415bfff640 1 -- 172.21.15.106:0/3198293219 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154030860 con 0x7f41640b2970 2024-04-16T12:57:26.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.406+0000 7f415bfff640 1 -- 172.21.15.106:0/3198293219 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154030c30 con 0x7f41640b2970 2024-04-16T12:57:26.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.407+0000 7f416b40d640 1 -- 172.21.15.106:0/3198293219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640b2970 msgr2=0x7f416413f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.407+0000 7f416b40d640 1 --2- 172.21.15.106:0/3198293219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640b2970 0x7f416413f9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4154009870 tx=0x7f415402b9a0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.407+0000 7f416b40d640 1 -- 172.21.15.106:0/3198293219 shutdown_connections 2024-04-16T12:57:26.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.407+0000 7f416b40d640 1 --2- 172.21.15.106:0/3198293219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640b2970 0x7f416413f9b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.407+0000 7f416b40d640 1 -- 172.21.15.106:0/3198293219 >> 172.21.15.106:0/3198293219 conn(0x7f4164067e20 msgr2=0x7f41640bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:26.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.407+0000 7f416b40d640 1 -- 172.21.15.106:0/3198293219 shutdown_connections 2024-04-16T12:57:26.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.407+0000 7f416b40d640 1 -- 172.21.15.106:0/3198293219 wait complete. 2024-04-16T12:57:26.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 Processor -- start 2024-04-16T12:57:26.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 -- start start 2024-04-16T12:57:26.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41640b2970 0x7f41641d1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640bbe20 0x7f41641cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416413fef0 0x7f4164142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f41640b4590 con 0x7f41640bbe20 2024-04-16T12:57:26.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4164140300 con 0x7f416413fef0 2024-04-16T12:57:26.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.408+0000 7f416b40d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41640b7960 con 0x7f41640b2970 2024-04-16T12:57:26.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640bbe20 0x7f41641cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640bbe20 0x7f41641cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42988/0 (socket says 172.21.15.106:42988) 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 -- 172.21.15.106:0/1943529446 learned_addr learned my addr 172.21.15.106:0/1943529446 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41699aa640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416413fef0 0x7f4164142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41691a9640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41640b2970 0x7f41641d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 -- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41640b2970 msgr2=0x7f41641d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41640b2970 0x7f41641d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 -- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416413fef0 msgr2=0x7f4164142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416413fef0 0x7f4164142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 -- 172.21.15.106:0/1943529446 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4164142070 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41699aa640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416413fef0 0x7f4164142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f41689a8640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640bbe20 0x7f41641cfb20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4154009870 tx=0x7f41540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f4159ffb640 1 -- 172.21.15.106:0/1943529446 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154034040 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f4159ffb640 1 -- 172.21.15.106:0/1943529446 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41540433f0 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f4159ffb640 1 -- 172.21.15.106:0/1943529446 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41540437e0 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41641d0db0 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.409+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41641d0310 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.410+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41640691a0 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.411+0000 7f4159ffb640 1 -- 172.21.15.106:0/1943529446 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f415404a060 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.411+0000 7f4159ffb640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f414806c920 0x7f414806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.411+0000 7f41691a9640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f414806c920 0x7f414806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.411+0000 7f4159ffb640 1 -- 172.21.15.106:0/1943529446 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f41540add90 con 0x7f41640bbe20 2024-04-16T12:57:26.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.412+0000 7f41691a9640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f414806c920 0x7f414806ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4160000f60 tx=0x7f4160009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.415+0000 7f4159ffb640 1 -- 172.21.15.106:0/1943529446 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f415403e070 con 0x7f41640bbe20 2024-04-16T12:57:26.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.588+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41641435c0 con 0x7f414806c920 2024-04-16T12:57:26.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.594+0000 7f4159ffb640 1 -- 172.21.15.106:0/1943529446 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f41641435c0 con 0x7f414806c920 2024-04-16T12:57:26.598 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:26.599 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f414806c920 msgr2=0x7f414806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f414806c920 0x7f414806ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4160000f60 tx=0x7f4160009040 comp rx=0 tx=0).stop 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640bbe20 msgr2=0x7f41641cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640bbe20 0x7f41641cfb20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4154009870 tx=0x7f41540046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 shutdown_connections 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f414806c920 0x7f414806ede0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416413fef0 0x7f4164142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41640bbe20 0x7f41641cfb20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 --2- 172.21.15.106:0/1943529446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41640b2970 0x7f41641d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.597+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 >> 172.21.15.106:0/1943529446 conn(0x7f4164067e20 msgr2=0x7f4164074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:26.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.598+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 shutdown_connections 2024-04-16T12:57:26.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.598+0000 7f416b40d640 1 -- 172.21.15.106:0/1943529446 wait complete. 2024-04-16T12:57:26.610 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-16T12:57:26.167339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001529"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897555+0000","last_change":"2024-04-16T12:57:18.894988+0000","last_active":"2024-04-16T12:57:19.897555+0000","last_peered":"2024-04-16T12:57:19.897555+0000","last_clean":"2024-04-16T12:57:19.897555+0000","last_became_active":"2024-04-16T12:57:18.894707+0000","last_became_peered":"2024-04-16T12:57:18.894707+0000","last_unstale":"2024-04-16T12:57:19.897555+0000","last_undegraded":"2024-04-16T12:57:19.897555+0000","last_fullsized":"2024-04-16T12:57:19.897555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:19.298247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895563+0000","last_change":"2024-04-16T12:57:18.906652+0000","last_active":"2024-04-16T12:57:19.895563+0000","last_peered":"2024-04-16T12:57:19.895563+0000","last_clean":"2024-04-16T12:57:19.895563+0000","last_became_active":"2024-04-16T12:57:18.906392+0000","last_became_peered":"2024-04-16T12:57:18.906392+0000","last_unstale":"2024-04-16T12:57:19.895563+0000","last_undegraded":"2024-04-16T12:57:19.895563+0000","last_fullsized":"2024-04-16T12:57:19.895563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997603+0000","last_change":"2024-04-16T12:57:18.900639+0000","last_active":"2024-04-16T12:57:19.997603+0000","last_peered":"2024-04-16T12:57:19.997603+0000","last_clean":"2024-04-16T12:57:19.997603+0000","last_became_active":"2024-04-16T12:57:18.900378+0000","last_became_peered":"2024-04-16T12:57:18.900378+0000","last_unstale":"2024-04-16T12:57:19.997603+0000","last_undegraded":"2024-04-16T12:57:19.997603+0000","last_fullsized":"2024-04-16T12:57:19.997603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896269+0000","last_change":"2024-04-16T12:57:18.907839+0000","last_active":"2024-04-16T12:57:19.896269+0000","last_peered":"2024-04-16T12:57:19.896269+0000","last_clean":"2024-04-16T12:57:19.896269+0000","last_became_active":"2024-04-16T12:57:18.907578+0000","last_became_peered":"2024-04-16T12:57:18.907578+0000","last_unstale":"2024-04-16T12:57:19.896269+0000","last_undegraded":"2024-04-16T12:57:19.896269+0000","last_fullsized":"2024-04-16T12:57:19.896269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896746+0000","last_change":"2024-04-16T12:57:18.893375+0000","last_active":"2024-04-16T12:57:19.896746+0000","last_peered":"2024-04-16T12:57:19.896746+0000","last_clean":"2024-04-16T12:57:19.896746+0000","last_became_active":"2024-04-16T12:57:18.893078+0000","last_became_peered":"2024-04-16T12:57:18.893078+0000","last_unstale":"2024-04-16T12:57:19.896746+0000","last_undegraded":"2024-04-16T12:57:19.896746+0000","last_fullsized":"2024-04-16T12:57:19.896746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896621+0000","last_change":"2024-04-16T12:57:18.896791+0000","last_active":"2024-04-16T12:57:19.896621+0000","last_peered":"2024-04-16T12:57:19.896621+0000","last_clean":"2024-04-16T12:57:19.896621+0000","last_became_active":"2024-04-16T12:57:18.896523+0000","last_became_peered":"2024-04-16T12:57:18.896523+0000","last_unstale":"2024-04-16T12:57:19.896621+0000","last_undegraded":"2024-04-16T12:57:19.896621+0000","last_fullsized":"2024-04-16T12:57:19.896621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:19.298247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895721+0000","last_change":"2024-04-16T12:57:18.897907+0000","last_active":"2024-04-16T12:57:19.895721+0000","last_peered":"2024-04-16T12:57:19.895721+0000","last_clean":"2024-04-16T12:57:19.895721+0000","last_became_active":"2024-04-16T12:57:18.897588+0000","last_became_peered":"2024-04-16T12:57:18.897588+0000","last_unstale":"2024-04-16T12:57:19.895721+0000","last_undegraded":"2024-04-16T12:57:19.895721+0000","last_fullsized":"2024-04-16T12:57:19.895721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223066+0000","last_change":"2024-04-16T12:57:18.907306+0000","last_active":"2024-04-16T12:57:20.223066+0000","last_peered":"2024-04-16T12:57:20.223066+0000","last_clean":"2024-04-16T12:57:20.223066+0000","last_became_active":"2024-04-16T12:57:18.906414+0000","last_became_peered":"2024-04-16T12:57:18.906414+0000","last_unstale":"2024-04-16T12:57:20.223066+0000","last_undegraded":"2024-04-16T12:57:20.223066+0000","last_fullsized":"2024-04-16T12:57:20.223066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897560+0000","last_change":"2024-04-16T12:57:18.897054+0000","last_active":"2024-04-16T12:57:19.897560+0000","last_peered":"2024-04-16T12:57:19.897560+0000","last_clean":"2024-04-16T12:57:19.897560+0000","last_became_active":"2024-04-16T12:57:18.896790+0000","last_became_peered":"2024-04-16T12:57:18.896790+0000","last_unstale":"2024-04-16T12:57:19.897560+0000","last_undegraded":"2024-04-16T12:57:19.897560+0000","last_fullsized":"2024-04-16T12:57:19.897560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:40:52.405695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900534+0000","last_change":"2024-04-16T12:57:18.904093+0000","last_active":"2024-04-16T12:57:19.900534+0000","last_peered":"2024-04-16T12:57:19.900534+0000","last_clean":"2024-04-16T12:57:19.900534+0000","last_became_active":"2024-04-16T12:57:18.903830+0000","last_became_peered":"2024-04-16T12:57:18.903830+0000","last_unstale":"2024-04-16T12:57:19.900534+0000","last_undegraded":"2024-04-16T12:57:19.900534+0000","last_fullsized":"2024-04-16T12:57:19.900534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900379+0000","last_change":"2024-04-16T12:57:18.906220+0000","last_active":"2024-04-16T12:57:19.900379+0000","last_peered":"2024-04-16T12:57:19.900379+0000","last_clean":"2024-04-16T12:57:19.900379+0000","last_became_active":"2024-04-16T12:57:18.905952+0000","last_became_peered":"2024-04-16T12:57:18.905952+0000","last_unstale":"2024-04-16T12:57:19.900379+0000","last_undegraded":"2024-04-16T12:57:19.900379+0000","last_fullsized":"2024-04-16T12:57:19.900379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223666+0000","last_change":"2024-04-16T12:57:18.903800+0000","last_active":"2024-04-16T12:57:20.223666+0000","last_peered":"2024-04-16T12:57:20.223666+0000","last_clean":"2024-04-16T12:57:20.223666+0000","last_became_active":"2024-04-16T12:57:18.903405+0000","last_became_peered":"2024-04-16T12:57:18.903405+0000","last_unstale":"2024-04-16T12:57:20.223666+0000","last_undegraded":"2024-04-16T12:57:20.223666+0000","last_fullsized":"2024-04-16T12:57:20.223666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:57.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223545+0000","last_change":"2024-04-16T12:57:18.907729+0000","last_active":"2024-04-16T12:57:20.223545+0000","last_peered":"2024-04-16T12:57:20.223545+0000","last_clean":"2024-04-16T12:57:20.223545+0000","last_became_active":"2024-04-16T12:57:18.907443+0000","last_became_peered":"2024-04-16T12:57:18.907443+0000","last_unstale":"2024-04-16T12:57:20.223545+0000","last_undegraded":"2024-04-16T12:57:20.223545+0000","last_fullsized":"2024-04-16T12:57:20.223545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997595+0000","last_change":"2024-04-16T12:57:18.901384+0000","last_active":"2024-04-16T12:57:19.997595+0000","last_peered":"2024-04-16T12:57:19.997595+0000","last_clean":"2024-04-16T12:57:19.997595+0000","last_became_active":"2024-04-16T12:57:18.900950+0000","last_became_peered":"2024-04-16T12:57:18.900950+0000","last_unstale":"2024-04-16T12:57:19.997595+0000","last_undegraded":"2024-04-16T12:57:19.997595+0000","last_fullsized":"2024-04-16T12:57:19.997595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895404+0000","last_change":"2024-04-16T12:57:18.895285+0000","last_active":"2024-04-16T12:57:19.895404+0000","last_peered":"2024-04-16T12:57:19.895404+0000","last_clean":"2024-04-16T12:57:19.895404+0000","last_became_active":"2024-04-16T12:57:18.895021+0000","last_became_peered":"2024-04-16T12:57:18.895021+0000","last_unstale":"2024-04-16T12:57:19.895404+0000","last_undegraded":"2024-04-16T12:57:19.895404+0000","last_fullsized":"2024-04-16T12:57:19.895404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896228+0000","last_change":"2024-04-16T12:57:18.901159+0000","last_active":"2024-04-16T12:57:19.896228+0000","last_peered":"2024-04-16T12:57:19.896228+0000","last_clean":"2024-04-16T12:57:19.896228+0000","last_became_active":"2024-04-16T12:57:18.899815+0000","last_became_peered":"2024-04-16T12:57:18.899815+0000","last_unstale":"2024-04-16T12:57:19.896228+0000","last_undegraded":"2024-04-16T12:57:19.896228+0000","last_fullsized":"2024-04-16T12:57:19.896228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896069+0000","last_change":"2024-04-16T12:57:18.899890+0000","last_active":"2024-04-16T12:57:19.896069+0000","last_peered":"2024-04-16T12:57:19.896069+0000","last_clean":"2024-04-16T12:57:19.896069+0000","last_became_active":"2024-04-16T12:57:18.899220+0000","last_became_peered":"2024-04-16T12:57:18.899220+0000","last_unstale":"2024-04-16T12:57:19.896069+0000","last_undegraded":"2024-04-16T12:57:19.896069+0000","last_fullsized":"2024-04-16T12:57:19.896069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223149+0000","last_change":"2024-04-16T12:57:18.895161+0000","last_active":"2024-04-16T12:57:20.223149+0000","last_peered":"2024-04-16T12:57:20.223149+0000","last_clean":"2024-04-16T12:57:20.223149+0000","last_became_active":"2024-04-16T12:57:18.894866+0000","last_became_peered":"2024-04-16T12:57:18.894866+0000","last_unstale":"2024-04-16T12:57:20.223149+0000","last_undegraded":"2024-04-16T12:57:20.223149+0000","last_fullsized":"2024-04-16T12:57:20.223149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:57.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897382+0000","last_change":"2024-04-16T12:57:18.896070+0000","last_active":"2024-04-16T12:57:19.897382+0000","last_peered":"2024-04-16T12:57:19.897382+0000","last_clean":"2024-04-16T12:57:19.897382+0000","last_became_active":"2024-04-16T12:57:18.895789+0000","last_became_peered":"2024-04-16T12:57:18.895789+0000","last_unstale":"2024-04-16T12:57:19.897382+0000","last_undegraded":"2024-04-16T12:57:19.897382+0000","last_fullsized":"2024-04-16T12:57:19.897382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:21.800505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900341+0000","last_change":"2024-04-16T12:57:18.902194+0000","last_active":"2024-04-16T12:57:19.900341+0000","last_peered":"2024-04-16T12:57:19.900341+0000","last_clean":"2024-04-16T12:57:19.900341+0000","last_became_active":"2024-04-16T12:57:18.901578+0000","last_became_peered":"2024-04-16T12:57:18.901578+0000","last_unstale":"2024-04-16T12:57:19.900341+0000","last_undegraded":"2024-04-16T12:57:19.900341+0000","last_fullsized":"2024-04-16T12:57:19.900341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997857+0000","last_change":"2024-04-16T12:57:18.904634+0000","last_active":"2024-04-16T12:57:19.997857+0000","last_peered":"2024-04-16T12:57:19.997857+0000","last_clean":"2024-04-16T12:57:19.997857+0000","last_became_active":"2024-04-16T12:57:18.904143+0000","last_became_peered":"2024-04-16T12:57:18.904143+0000","last_unstale":"2024-04-16T12:57:19.997857+0000","last_undegraded":"2024-04-16T12:57:19.997857+0000","last_fullsized":"2024-04-16T12:57:19.997857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896620+0000","last_change":"2024-04-16T12:57:18.902458+0000","last_active":"2024-04-16T12:57:19.896620+0000","last_peered":"2024-04-16T12:57:19.896620+0000","last_clean":"2024-04-16T12:57:19.896620+0000","last_became_active":"2024-04-16T12:57:18.901188+0000","last_became_peered":"2024-04-16T12:57:18.901188+0000","last_unstale":"2024-04-16T12:57:19.896620+0000","last_undegraded":"2024-04-16T12:57:19.896620+0000","last_fullsized":"2024-04-16T12:57:19.896620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:40:52.405695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223334+0000","last_change":"2024-04-16T12:57:18.909655+0000","last_active":"2024-04-16T12:57:20.223334+0000","last_peered":"2024-04-16T12:57:20.223334+0000","last_clean":"2024-04-16T12:57:20.223334+0000","last_became_active":"2024-04-16T12:57:18.909392+0000","last_became_peered":"2024-04-16T12:57:18.909392+0000","last_unstale":"2024-04-16T12:57:20.223334+0000","last_undegraded":"2024-04-16T12:57:20.223334+0000","last_fullsized":"2024-04-16T12:57:20.223334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896552+0000","last_change":"2024-04-16T12:57:18.901325+0000","last_active":"2024-04-16T12:57:19.896552+0000","last_peered":"2024-04-16T12:57:19.896552+0000","last_clean":"2024-04-16T12:57:19.896552+0000","last_became_active":"2024-04-16T12:57:18.900839+0000","last_became_peered":"2024-04-16T12:57:18.900839+0000","last_unstale":"2024-04-16T12:57:19.896552+0000","last_undegraded":"2024-04-16T12:57:19.896552+0000","last_fullsized":"2024-04-16T12:57:19.896552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:21.800505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223740+0000","last_change":"2024-04-16T12:57:18.912510+0000","last_active":"2024-04-16T12:57:20.223740+0000","last_peered":"2024-04-16T12:57:20.223740+0000","last_clean":"2024-04-16T12:57:20.223740+0000","last_became_active":"2024-04-16T12:57:18.912214+0000","last_became_peered":"2024-04-16T12:57:18.912214+0000","last_unstale":"2024-04-16T12:57:20.223740+0000","last_undegraded":"2024-04-16T12:57:20.223740+0000","last_fullsized":"2024-04-16T12:57:20.223740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900599+0000","last_change":"2024-04-16T12:57:18.898047+0000","last_active":"2024-04-16T12:57:19.900599+0000","last_peered":"2024-04-16T12:57:19.900599+0000","last_clean":"2024-04-16T12:57:19.900599+0000","last_became_active":"2024-04-16T12:57:18.897665+0000","last_became_peered":"2024-04-16T12:57:18.897665+0000","last_unstale":"2024-04-16T12:57:19.900599+0000","last_undegraded":"2024-04-16T12:57:19.900599+0000","last_fullsized":"2024-04-16T12:57:19.900599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895472+0000","last_change":"2024-04-16T12:57:18.899681+0000","last_active":"2024-04-16T12:57:19.895472+0000","last_peered":"2024-04-16T12:57:19.895472+0000","last_clean":"2024-04-16T12:57:19.895472+0000","last_became_active":"2024-04-16T12:57:18.899371+0000","last_became_peered":"2024-04-16T12:57:18.899371+0000","last_unstale":"2024-04-16T12:57:19.895472+0000","last_undegraded":"2024-04-16T12:57:19.895472+0000","last_fullsized":"2024-04-16T12:57:19.895472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223764+0000","last_change":"2024-04-16T12:57:18.907309+0000","last_active":"2024-04-16T12:57:20.223764+0000","last_peered":"2024-04-16T12:57:20.223764+0000","last_clean":"2024-04-16T12:57:20.223764+0000","last_became_active":"2024-04-16T12:57:18.906438+0000","last_became_peered":"2024-04-16T12:57:18.906438+0000","last_unstale":"2024-04-16T12:57:20.223764+0000","last_undegraded":"2024-04-16T12:57:20.223764+0000","last_fullsized":"2024-04-16T12:57:20.223764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:09.872157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997593+0000","last_change":"2024-04-16T12:57:18.900069+0000","last_active":"2024-04-16T12:57:19.997593+0000","last_peered":"2024-04-16T12:57:19.997593+0000","last_clean":"2024-04-16T12:57:19.997593+0000","last_became_active":"2024-04-16T12:57:18.899776+0000","last_became_peered":"2024-04-16T12:57:18.899776+0000","last_unstale":"2024-04-16T12:57:19.997593+0000","last_undegraded":"2024-04-16T12:57:19.997593+0000","last_fullsized":"2024-04-16T12:57:19.997593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:05.692833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897104+0000","last_change":"2024-04-16T12:57:18.902474+0000","last_active":"2024-04-16T12:57:19.897104+0000","last_peered":"2024-04-16T12:57:19.897104+0000","last_clean":"2024-04-16T12:57:19.897104+0000","last_became_active":"2024-04-16T12:57:18.902171+0000","last_became_peered":"2024-04-16T12:57:18.902171+0000","last_unstale":"2024-04-16T12:57:19.897104+0000","last_undegraded":"2024-04-16T12:57:19.897104+0000","last_fullsized":"2024-04-16T12:57:19.897104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:49.068626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223228+0000","last_change":"2024-04-16T12:57:18.897371+0000","last_active":"2024-04-16T12:57:20.223228+0000","last_peered":"2024-04-16T12:57:20.223228+0000","last_clean":"2024-04-16T12:57:20.223228+0000","last_became_active":"2024-04-16T12:57:18.897132+0000","last_became_peered":"2024-04-16T12:57:18.897132+0000","last_unstale":"2024-04-16T12:57:20.223228+0000","last_undegraded":"2024-04-16T12:57:20.223228+0000","last_fullsized":"2024-04-16T12:57:20.223228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:46:42.662630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900198+0000","last_change":"2024-04-16T12:57:18.903430+0000","last_active":"2024-04-16T12:57:19.900198+0000","last_peered":"2024-04-16T12:57:19.900198+0000","last_clean":"2024-04-16T12:57:19.900198+0000","last_became_active":"2024-04-16T12:57:18.903167+0000","last_became_peered":"2024-04-16T12:57:18.903167+0000","last_unstale":"2024-04-16T12:57:19.900198+0000","last_undegraded":"2024-04-16T12:57:19.900198+0000","last_fullsized":"2024-04-16T12:57:19.900198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:28.087268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223458+0000","last_change":"2024-04-16T12:57:18.906576+0000","last_active":"2024-04-16T12:57:20.223458+0000","last_peered":"2024-04-16T12:57:20.223458+0000","last_clean":"2024-04-16T12:57:20.223458+0000","last_became_active":"2024-04-16T12:57:18.906321+0000","last_became_peered":"2024-04-16T12:57:18.906321+0000","last_unstale":"2024-04-16T12:57:20.223458+0000","last_undegraded":"2024-04-16T12:57:20.223458+0000","last_fullsized":"2024-04-16T12:57:20.223458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:19.721593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223780+0000","last_change":"2024-04-16T12:57:17.891624+0000","last_active":"2024-04-16T12:57:20.223780+0000","last_peered":"2024-04-16T12:57:20.223780+0000","last_clean":"2024-04-16T12:57:20.223780+0000","last_became_active":"2024-04-16T12:57:17.891348+0000","last_became_peered":"2024-04-16T12:57:17.891348+0000","last_unstale":"2024-04-16T12:57:20.223780+0000","last_undegraded":"2024-04-16T12:57:20.223780+0000","last_fullsized":"2024-04-16T12:57:20.223780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:08.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997737+0000","last_change":"2024-04-16T12:57:18.899842+0000","last_active":"2024-04-16T12:57:19.997737+0000","last_peered":"2024-04-16T12:57:19.997737+0000","last_clean":"2024-04-16T12:57:19.997737+0000","last_became_active":"2024-04-16T12:57:18.899567+0000","last_became_peered":"2024-04-16T12:57:18.899567+0000","last_unstale":"2024-04-16T12:57:19.997737+0000","last_undegraded":"2024-04-16T12:57:19.997737+0000","last_fullsized":"2024-04-16T12:57:19.997737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900224+0000","last_change":"2024-04-16T12:57:17.897716+0000","last_active":"2024-04-16T12:57:19.900224+0000","last_peered":"2024-04-16T12:57:19.900224+0000","last_clean":"2024-04-16T12:57:19.900224+0000","last_became_active":"2024-04-16T12:57:17.897340+0000","last_became_peered":"2024-04-16T12:57:17.897340+0000","last_unstale":"2024-04-16T12:57:19.900224+0000","last_undegraded":"2024-04-16T12:57:19.900224+0000","last_fullsized":"2024-04-16T12:57:19.900224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223387+0000","last_change":"2024-04-16T12:57:17.897950+0000","last_active":"2024-04-16T12:57:20.223387+0000","last_peered":"2024-04-16T12:57:20.223387+0000","last_clean":"2024-04-16T12:57:20.223387+0000","last_became_active":"2024-04-16T12:57:17.897654+0000","last_became_peered":"2024-04-16T12:57:17.897654+0000","last_unstale":"2024-04-16T12:57:20.223387+0000","last_undegraded":"2024-04-16T12:57:20.223387+0000","last_fullsized":"2024-04-16T12:57:20.223387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223239+0000","last_change":"2024-04-16T12:57:18.904139+0000","last_active":"2024-04-16T12:57:20.223239+0000","last_peered":"2024-04-16T12:57:20.223239+0000","last_clean":"2024-04-16T12:57:20.223239+0000","last_became_active":"2024-04-16T12:57:18.903879+0000","last_became_peered":"2024-04-16T12:57:18.903879+0000","last_unstale":"2024-04-16T12:57:20.223239+0000","last_undegraded":"2024-04-16T12:57:20.223239+0000","last_fullsized":"2024-04-16T12:57:20.223239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896409+0000","last_change":"2024-04-16T12:57:17.892280+0000","last_active":"2024-04-16T12:57:19.896409+0000","last_peered":"2024-04-16T12:57:19.896409+0000","last_clean":"2024-04-16T12:57:19.896409+0000","last_became_active":"2024-04-16T12:57:17.891970+0000","last_became_peered":"2024-04-16T12:57:17.891970+0000","last_unstale":"2024-04-16T12:57:19.896409+0000","last_undegraded":"2024-04-16T12:57:19.896409+0000","last_fullsized":"2024-04-16T12:57:19.896409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895378+0000","last_change":"2024-04-16T12:57:18.898579+0000","last_active":"2024-04-16T12:57:19.895378+0000","last_peered":"2024-04-16T12:57:19.895378+0000","last_clean":"2024-04-16T12:57:19.895378+0000","last_became_active":"2024-04-16T12:57:18.898342+0000","last_became_peered":"2024-04-16T12:57:18.898342+0000","last_unstale":"2024-04-16T12:57:19.895378+0000","last_undegraded":"2024-04-16T12:57:19.895378+0000","last_fullsized":"2024-04-16T12:57:19.895378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900530+0000","last_change":"2024-04-16T12:57:17.903930+0000","last_active":"2024-04-16T12:57:19.900530+0000","last_peered":"2024-04-16T12:57:19.900530+0000","last_clean":"2024-04-16T12:57:19.900530+0000","last_became_active":"2024-04-16T12:57:17.903601+0000","last_became_peered":"2024-04-16T12:57:17.903601+0000","last_unstale":"2024-04-16T12:57:19.900530+0000","last_undegraded":"2024-04-16T12:57:19.900530+0000","last_fullsized":"2024-04-16T12:57:19.900530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895926+0000","last_change":"2024-04-16T12:57:18.903250+0000","last_active":"2024-04-16T12:57:19.895926+0000","last_peered":"2024-04-16T12:57:19.895926+0000","last_clean":"2024-04-16T12:57:19.895926+0000","last_became_active":"2024-04-16T12:57:18.897774+0000","last_became_peered":"2024-04-16T12:57:18.897774+0000","last_unstale":"2024-04-16T12:57:19.895926+0000","last_undegraded":"2024-04-16T12:57:19.895926+0000","last_fullsized":"2024-04-16T12:57:19.895926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896048+0000","last_change":"2024-04-16T12:57:17.901204+0000","last_active":"2024-04-16T12:57:19.896048+0000","last_peered":"2024-04-16T12:57:19.896048+0000","last_clean":"2024-04-16T12:57:19.896048+0000","last_became_active":"2024-04-16T12:57:17.900178+0000","last_became_peered":"2024-04-16T12:57:17.900178+0000","last_unstale":"2024-04-16T12:57:19.896048+0000","last_undegraded":"2024-04-16T12:57:19.896048+0000","last_fullsized":"2024-04-16T12:57:19.896048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997681+0000","last_change":"2024-04-16T12:57:18.900906+0000","last_active":"2024-04-16T12:57:19.997681+0000","last_peered":"2024-04-16T12:57:19.997681+0000","last_clean":"2024-04-16T12:57:19.997681+0000","last_became_active":"2024-04-16T12:57:18.896865+0000","last_became_peered":"2024-04-16T12:57:18.896865+0000","last_unstale":"2024-04-16T12:57:19.997681+0000","last_undegraded":"2024-04-16T12:57:19.997681+0000","last_fullsized":"2024-04-16T12:57:19.997681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:14.820150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895655+0000","last_change":"2024-04-16T12:57:17.904087+0000","last_active":"2024-04-16T12:57:19.895655+0000","last_peered":"2024-04-16T12:57:19.895655+0000","last_clean":"2024-04-16T12:57:19.895655+0000","last_became_active":"2024-04-16T12:57:17.903731+0000","last_became_peered":"2024-04-16T12:57:17.903731+0000","last_unstale":"2024-04-16T12:57:19.895655+0000","last_undegraded":"2024-04-16T12:57:19.895655+0000","last_fullsized":"2024-04-16T12:57:19.895655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223665+0000","last_change":"2024-04-16T12:57:18.900730+0000","last_active":"2024-04-16T12:57:20.223665+0000","last_peered":"2024-04-16T12:57:20.223665+0000","last_clean":"2024-04-16T12:57:20.223665+0000","last_became_active":"2024-04-16T12:57:18.899959+0000","last_became_peered":"2024-04-16T12:57:18.899959+0000","last_unstale":"2024-04-16T12:57:20.223665+0000","last_undegraded":"2024-04-16T12:57:20.223665+0000","last_fullsized":"2024-04-16T12:57:20.223665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:46:42.662630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900311+0000","last_change":"2024-04-16T12:57:17.903883+0000","last_active":"2024-04-16T12:57:19.900311+0000","last_peered":"2024-04-16T12:57:19.900311+0000","last_clean":"2024-04-16T12:57:19.900311+0000","last_became_active":"2024-04-16T12:57:17.903572+0000","last_became_peered":"2024-04-16T12:57:17.903572+0000","last_unstale":"2024-04-16T12:57:19.900311+0000","last_undegraded":"2024-04-16T12:57:19.900311+0000","last_fullsized":"2024-04-16T12:57:19.900311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897063+0000","last_change":"2024-04-16T12:57:18.899095+0000","last_active":"2024-04-16T12:57:19.897063+0000","last_peered":"2024-04-16T12:57:19.897063+0000","last_clean":"2024-04-16T12:57:19.897063+0000","last_became_active":"2024-04-16T12:57:18.898825+0000","last_became_peered":"2024-04-16T12:57:18.898825+0000","last_unstale":"2024-04-16T12:57:19.897063+0000","last_undegraded":"2024-04-16T12:57:19.897063+0000","last_fullsized":"2024-04-16T12:57:19.897063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:16.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997825+0000","last_change":"2024-04-16T12:57:17.903777+0000","last_active":"2024-04-16T12:57:19.997825+0000","last_peered":"2024-04-16T12:57:19.997825+0000","last_clean":"2024-04-16T12:57:19.997825+0000","last_became_active":"2024-04-16T12:57:17.903478+0000","last_became_peered":"2024-04-16T12:57:17.903478+0000","last_unstale":"2024-04-16T12:57:19.997825+0000","last_undegraded":"2024-04-16T12:57:19.997825+0000","last_fullsized":"2024-04-16T12:57:19.997825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:57:14.224709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997484+0000","last_change":"2024-04-16T12:57:18.903190+0000","last_active":"2024-04-16T12:57:19.997484+0000","last_peered":"2024-04-16T12:57:19.997484+0000","last_clean":"2024-04-16T12:57:19.997484+0000","last_became_active":"2024-04-16T12:57:18.902934+0000","last_became_peered":"2024-04-16T12:57:18.902934+0000","last_unstale":"2024-04-16T12:57:19.997484+0000","last_undegraded":"2024-04-16T12:57:19.997484+0000","last_fullsized":"2024-04-16T12:57:19.997484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:37.114869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897144+0000","last_change":"2024-04-16T12:57:17.902218+0000","last_active":"2024-04-16T12:57:19.897144+0000","last_peered":"2024-04-16T12:57:19.897144+0000","last_clean":"2024-04-16T12:57:19.897144+0000","last_became_active":"2024-04-16T12:57:17.901896+0000","last_became_peered":"2024-04-16T12:57:17.901896+0000","last_unstale":"2024-04-16T12:57:19.897144+0000","last_undegraded":"2024-04-16T12:57:19.897144+0000","last_fullsized":"2024-04-16T12:57:19.897144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896906+0000","last_change":"2024-04-16T12:57:18.900704+0000","last_active":"2024-04-16T12:57:19.896906+0000","last_peered":"2024-04-16T12:57:19.896906+0000","last_clean":"2024-04-16T12:57:19.896906+0000","last_became_active":"2024-04-16T12:57:18.900420+0000","last_became_peered":"2024-04-16T12:57:18.900420+0000","last_unstale":"2024-04-16T12:57:19.896906+0000","last_undegraded":"2024-04-16T12:57:19.896906+0000","last_fullsized":"2024-04-16T12:57:19.896906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900170+0000","last_change":"2024-04-16T12:57:17.901200+0000","last_active":"2024-04-16T12:57:19.900170+0000","last_peered":"2024-04-16T12:57:19.900170+0000","last_clean":"2024-04-16T12:57:19.900170+0000","last_became_active":"2024-04-16T12:57:17.900900+0000","last_became_peered":"2024-04-16T12:57:17.900900+0000","last_unstale":"2024-04-16T12:57:19.900170+0000","last_undegraded":"2024-04-16T12:57:19.900170+0000","last_fullsized":"2024-04-16T12:57:19.900170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900247+0000","last_change":"2024-04-16T12:57:18.901730+0000","last_active":"2024-04-16T12:57:19.900247+0000","last_peered":"2024-04-16T12:57:19.900247+0000","last_clean":"2024-04-16T12:57:19.900247+0000","last_became_active":"2024-04-16T12:57:18.901341+0000","last_became_peered":"2024-04-16T12:57:18.901341+0000","last_unstale":"2024-04-16T12:57:19.900247+0000","last_undegraded":"2024-04-16T12:57:19.900247+0000","last_fullsized":"2024-04-16T12:57:19.900247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223017+0000","last_change":"2024-04-16T12:57:17.897292+0000","last_active":"2024-04-16T12:57:20.223017+0000","last_peered":"2024-04-16T12:57:20.223017+0000","last_clean":"2024-04-16T12:57:20.223017+0000","last_became_active":"2024-04-16T12:57:17.896999+0000","last_became_peered":"2024-04-16T12:57:17.896999+0000","last_unstale":"2024-04-16T12:57:20.223017+0000","last_undegraded":"2024-04-16T12:57:20.223017+0000","last_fullsized":"2024-04-16T12:57:20.223017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:59:03.198521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895645+0000","last_change":"2024-04-16T12:57:18.896129+0000","last_active":"2024-04-16T12:57:19.895645+0000","last_peered":"2024-04-16T12:57:19.895645+0000","last_clean":"2024-04-16T12:57:19.895645+0000","last_became_active":"2024-04-16T12:57:18.895812+0000","last_became_peered":"2024-04-16T12:57:18.895812+0000","last_unstale":"2024-04-16T12:57:19.895645+0000","last_undegraded":"2024-04-16T12:57:19.895645+0000","last_fullsized":"2024-04-16T12:57:19.895645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223695+0000","last_change":"2024-04-16T12:57:17.905436+0000","last_active":"2024-04-16T12:57:20.223695+0000","last_peered":"2024-04-16T12:57:20.223695+0000","last_clean":"2024-04-16T12:57:20.223695+0000","last_became_active":"2024-04-16T12:57:17.905189+0000","last_became_peered":"2024-04-16T12:57:17.905189+0000","last_unstale":"2024-04-16T12:57:20.223695+0000","last_undegraded":"2024-04-16T12:57:20.223695+0000","last_fullsized":"2024-04-16T12:57:20.223695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:57:14.224709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896980+0000","last_change":"2024-04-16T12:57:18.893937+0000","last_active":"2024-04-16T12:57:19.896980+0000","last_peered":"2024-04-16T12:57:19.896980+0000","last_clean":"2024-04-16T12:57:19.896980+0000","last_became_active":"2024-04-16T12:57:18.893558+0000","last_became_peered":"2024-04-16T12:57:18.893558+0000","last_unstale":"2024-04-16T12:57:19.896980+0000","last_undegraded":"2024-04-16T12:57:19.896980+0000","last_fullsized":"2024-04-16T12:57:19.896980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223442+0000","last_change":"2024-04-16T12:57:17.896413+0000","last_active":"2024-04-16T12:57:20.223442+0000","last_peered":"2024-04-16T12:57:20.223442+0000","last_clean":"2024-04-16T12:57:20.223442+0000","last_became_active":"2024-04-16T12:57:17.896134+0000","last_became_peered":"2024-04-16T12:57:17.896134+0000","last_unstale":"2024-04-16T12:57:20.223442+0000","last_undegraded":"2024-04-16T12:57:20.223442+0000","last_fullsized":"2024-04-16T12:57:20.223442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897649+0000","last_change":"2024-04-16T12:57:18.896924+0000","last_active":"2024-04-16T12:57:19.897649+0000","last_peered":"2024-04-16T12:57:19.897649+0000","last_clean":"2024-04-16T12:57:19.897649+0000","last_became_active":"2024-04-16T12:57:18.896402+0000","last_became_peered":"2024-04-16T12:57:18.896402+0000","last_unstale":"2024-04-16T12:57:19.897649+0000","last_undegraded":"2024-04-16T12:57:19.897649+0000","last_fullsized":"2024-04-16T12:57:19.897649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:49.068626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895731+0000","last_change":"2024-04-16T12:57:17.898110+0000","last_active":"2024-04-16T12:57:19.895731+0000","last_peered":"2024-04-16T12:57:19.895731+0000","last_clean":"2024-04-16T12:57:19.895731+0000","last_became_active":"2024-04-16T12:57:17.897814+0000","last_became_peered":"2024-04-16T12:57:17.897814+0000","last_unstale":"2024-04-16T12:57:19.895731+0000","last_undegraded":"2024-04-16T12:57:19.895731+0000","last_fullsized":"2024-04-16T12:57:19.895731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896466+0000","last_change":"2024-04-16T12:57:18.907293+0000","last_active":"2024-04-16T12:57:19.896466+0000","last_peered":"2024-04-16T12:57:19.896466+0000","last_clean":"2024-04-16T12:57:19.896466+0000","last_became_active":"2024-04-16T12:57:18.906995+0000","last_became_peered":"2024-04-16T12:57:18.906995+0000","last_unstale":"2024-04-16T12:57:19.896466+0000","last_undegraded":"2024-04-16T12:57:19.896466+0000","last_fullsized":"2024-04-16T12:57:19.896466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.051530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223511+0000","last_change":"2024-04-16T12:57:17.895622+0000","last_active":"2024-04-16T12:57:20.223511+0000","last_peered":"2024-04-16T12:57:20.223511+0000","last_clean":"2024-04-16T12:57:20.223511+0000","last_became_active":"2024-04-16T12:57:17.895299+0000","last_became_peered":"2024-04-16T12:57:17.895299+0000","last_unstale":"2024-04-16T12:57:20.223511+0000","last_undegraded":"2024-04-16T12:57:20.223511+0000","last_fullsized":"2024-04-16T12:57:20.223511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897213+0000","last_change":"2024-04-16T12:57:18.897653+0000","last_active":"2024-04-16T12:57:19.897213+0000","last_peered":"2024-04-16T12:57:19.897213+0000","last_clean":"2024-04-16T12:57:19.897213+0000","last_became_active":"2024-04-16T12:57:18.897367+0000","last_became_peered":"2024-04-16T12:57:18.897367+0000","last_unstale":"2024-04-16T12:57:19.897213+0000","last_undegraded":"2024-04-16T12:57:19.897213+0000","last_fullsized":"2024-04-16T12:57:19.897213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.051530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895537+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:19.895537+0000","last_peered":"2024-04-16T12:57:19.895537+0000","last_clean":"2024-04-16T12:57:19.895537+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:19.895537+0000","last_undegraded":"2024-04-16T12:57:19.895537+0000","last_fullsized":"2024-04-16T12:57:19.895537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895665+0000","last_change":"2024-04-16T12:57:17.902517+0000","last_active":"2024-04-16T12:57:19.895665+0000","last_peered":"2024-04-16T12:57:19.895665+0000","last_clean":"2024-04-16T12:57:19.895665+0000","last_became_active":"2024-04-16T12:57:17.902160+0000","last_became_peered":"2024-04-16T12:57:17.902160+0000","last_unstale":"2024-04-16T12:57:19.895665+0000","last_undegraded":"2024-04-16T12:57:19.895665+0000","last_fullsized":"2024-04-16T12:57:19.895665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223681+0000","last_change":"2024-04-16T12:57:18.906944+0000","last_active":"2024-04-16T12:57:20.223681+0000","last_peered":"2024-04-16T12:57:20.223681+0000","last_clean":"2024-04-16T12:57:20.223681+0000","last_became_active":"2024-04-16T12:57:18.906072+0000","last_became_peered":"2024-04-16T12:57:18.906072+0000","last_unstale":"2024-04-16T12:57:20.223681+0000","last_undegraded":"2024-04-16T12:57:20.223681+0000","last_fullsized":"2024-04-16T12:57:20.223681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:21.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895471+0000","last_change":"2024-04-16T12:57:17.898599+0000","last_active":"2024-04-16T12:57:19.895471+0000","last_peered":"2024-04-16T12:57:19.895471+0000","last_clean":"2024-04-16T12:57:19.895471+0000","last_became_active":"2024-04-16T12:57:17.898297+0000","last_became_peered":"2024-04-16T12:57:17.898297+0000","last_unstale":"2024-04-16T12:57:19.895471+0000","last_undegraded":"2024-04-16T12:57:19.895471+0000","last_fullsized":"2024-04-16T12:57:19.895471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997392+0000","last_change":"2024-04-16T12:57:18.900390+0000","last_active":"2024-04-16T12:57:19.997392+0000","last_peered":"2024-04-16T12:57:19.997392+0000","last_clean":"2024-04-16T12:57:19.997392+0000","last_became_active":"2024-04-16T12:57:18.900127+0000","last_became_peered":"2024-04-16T12:57:18.900127+0000","last_unstale":"2024-04-16T12:57:19.997392+0000","last_undegraded":"2024-04-16T12:57:19.997392+0000","last_fullsized":"2024-04-16T12:57:19.997392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:15:47.405509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223323+0000","last_change":"2024-04-16T12:57:17.896418+0000","last_active":"2024-04-16T12:57:20.223323+0000","last_peered":"2024-04-16T12:57:20.223323+0000","last_clean":"2024-04-16T12:57:20.223323+0000","last_became_active":"2024-04-16T12:57:17.896171+0000","last_became_peered":"2024-04-16T12:57:17.896171+0000","last_unstale":"2024-04-16T12:57:20.223323+0000","last_undegraded":"2024-04-16T12:57:20.223323+0000","last_fullsized":"2024-04-16T12:57:20.223323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895348+0000","last_change":"2024-04-16T12:57:18.895902+0000","last_active":"2024-04-16T12:57:19.895348+0000","last_peered":"2024-04-16T12:57:19.895348+0000","last_clean":"2024-04-16T12:57:19.895348+0000","last_became_active":"2024-04-16T12:57:18.895646+0000","last_became_peered":"2024-04-16T12:57:18.895646+0000","last_unstale":"2024-04-16T12:57:19.895348+0000","last_undegraded":"2024-04-16T12:57:19.895348+0000","last_fullsized":"2024-04-16T12:57:19.895348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:49.648241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897213+0000","last_change":"2024-04-16T12:57:17.899456+0000","last_active":"2024-04-16T12:57:19.897213+0000","last_peered":"2024-04-16T12:57:19.897213+0000","last_clean":"2024-04-16T12:57:19.897213+0000","last_became_active":"2024-04-16T12:57:17.898313+0000","last_became_peered":"2024-04-16T12:57:17.898313+0000","last_unstale":"2024-04-16T12:57:19.897213+0000","last_undegraded":"2024-04-16T12:57:19.897213+0000","last_fullsized":"2024-04-16T12:57:19.897213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223517+0000","last_change":"2024-04-16T12:57:18.904379+0000","last_active":"2024-04-16T12:57:20.223517+0000","last_peered":"2024-04-16T12:57:20.223517+0000","last_clean":"2024-04-16T12:57:20.223517+0000","last_became_active":"2024-04-16T12:57:18.904118+0000","last_became_peered":"2024-04-16T12:57:18.904118+0000","last_unstale":"2024-04-16T12:57:20.223517+0000","last_undegraded":"2024-04-16T12:57:20.223517+0000","last_fullsized":"2024-04-16T12:57:20.223517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:03.297461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895700+0000","last_change":"2024-04-16T12:57:17.905541+0000","last_active":"2024-04-16T12:57:19.895700+0000","last_peered":"2024-04-16T12:57:19.895700+0000","last_clean":"2024-04-16T12:57:19.895700+0000","last_became_active":"2024-04-16T12:57:17.905253+0000","last_became_peered":"2024-04-16T12:57:17.905253+0000","last_unstale":"2024-04-16T12:57:19.895700+0000","last_undegraded":"2024-04-16T12:57:19.895700+0000","last_fullsized":"2024-04-16T12:57:19.895700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896326+0000","last_change":"2024-04-16T12:57:18.908431+0000","last_active":"2024-04-16T12:57:19.896326+0000","last_peered":"2024-04-16T12:57:19.896326+0000","last_clean":"2024-04-16T12:57:19.896326+0000","last_became_active":"2024-04-16T12:57:18.908069+0000","last_became_peered":"2024-04-16T12:57:18.908069+0000","last_unstale":"2024-04-16T12:57:19.896326+0000","last_undegraded":"2024-04-16T12:57:19.896326+0000","last_fullsized":"2024-04-16T12:57:19.896326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897403+0000","last_change":"2024-04-16T12:57:17.902749+0000","last_active":"2024-04-16T12:57:19.897403+0000","last_peered":"2024-04-16T12:57:19.897403+0000","last_clean":"2024-04-16T12:57:19.897403+0000","last_became_active":"2024-04-16T12:57:17.902368+0000","last_became_peered":"2024-04-16T12:57:17.902368+0000","last_unstale":"2024-04-16T12:57:19.897403+0000","last_undegraded":"2024-04-16T12:57:19.897403+0000","last_fullsized":"2024-04-16T12:57:19.897403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:55.997554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895628+0000","last_change":"2024-04-16T12:57:18.897877+0000","last_active":"2024-04-16T12:57:19.895628+0000","last_peered":"2024-04-16T12:57:19.895628+0000","last_clean":"2024-04-16T12:57:19.895628+0000","last_became_active":"2024-04-16T12:57:18.897246+0000","last_became_peered":"2024-04-16T12:57:18.897246+0000","last_unstale":"2024-04-16T12:57:19.895628+0000","last_undegraded":"2024-04-16T12:57:19.895628+0000","last_fullsized":"2024-04-16T12:57:19.895628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.899642+0000","last_change":"2024-04-16T12:57:17.894217+0000","last_active":"2024-04-16T12:57:19.899642+0000","last_peered":"2024-04-16T12:57:19.899642+0000","last_clean":"2024-04-16T12:57:19.899642+0000","last_became_active":"2024-04-16T12:57:17.893946+0000","last_became_peered":"2024-04-16T12:57:17.893946+0000","last_unstale":"2024-04-16T12:57:19.899642+0000","last_undegraded":"2024-04-16T12:57:19.899642+0000","last_fullsized":"2024-04-16T12:57:19.899642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:02.292438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223783+0000","last_change":"2024-04-16T12:57:18.898378+0000","last_active":"2024-04-16T12:57:20.223783+0000","last_peered":"2024-04-16T12:57:20.223783+0000","last_clean":"2024-04-16T12:57:20.223783+0000","last_became_active":"2024-04-16T12:57:18.898091+0000","last_became_peered":"2024-04-16T12:57:18.898091+0000","last_unstale":"2024-04-16T12:57:20.223783+0000","last_undegraded":"2024-04-16T12:57:20.223783+0000","last_fullsized":"2024-04-16T12:57:20.223783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:35.895207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900585+0000","last_change":"2024-04-16T12:57:17.897818+0000","last_active":"2024-04-16T12:57:19.900585+0000","last_peered":"2024-04-16T12:57:19.900585+0000","last_clean":"2024-04-16T12:57:19.900585+0000","last_became_active":"2024-04-16T12:57:17.897513+0000","last_became_peered":"2024-04-16T12:57:17.897513+0000","last_unstale":"2024-04-16T12:57:19.900585+0000","last_undegraded":"2024-04-16T12:57:19.900585+0000","last_fullsized":"2024-04-16T12:57:19.900585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:54.080062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997652+0000","last_change":"2024-04-16T12:57:18.902147+0000","last_active":"2024-04-16T12:57:19.997652+0000","last_peered":"2024-04-16T12:57:19.997652+0000","last_clean":"2024-04-16T12:57:19.997652+0000","last_became_active":"2024-04-16T12:57:18.901853+0000","last_became_peered":"2024-04-16T12:57:18.901853+0000","last_unstale":"2024-04-16T12:57:19.997652+0000","last_undegraded":"2024-04-16T12:57:19.997652+0000","last_fullsized":"2024-04-16T12:57:19.997652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895498+0000","last_change":"2024-04-16T12:57:17.905371+0000","last_active":"2024-04-16T12:57:19.895498+0000","last_peered":"2024-04-16T12:57:19.895498+0000","last_clean":"2024-04-16T12:57:19.895498+0000","last_became_active":"2024-04-16T12:57:17.905116+0000","last_became_peered":"2024-04-16T12:57:17.905116+0000","last_unstale":"2024-04-16T12:57:19.895498+0000","last_undegraded":"2024-04-16T12:57:19.895498+0000","last_fullsized":"2024-04-16T12:57:19.895498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:56:57.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223378+0000","last_change":"2024-04-16T12:57:18.897144+0000","last_active":"2024-04-16T12:57:20.223378+0000","last_peered":"2024-04-16T12:57:20.223378+0000","last_clean":"2024-04-16T12:57:20.223378+0000","last_became_active":"2024-04-16T12:57:18.896856+0000","last_became_peered":"2024-04-16T12:57:18.896856+0000","last_unstale":"2024-04-16T12:57:20.223378+0000","last_undegraded":"2024-04-16T12:57:20.223378+0000","last_fullsized":"2024-04-16T12:57:20.223378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:30:55.085085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895467+0000","last_change":"2024-04-16T12:57:17.900711+0000","last_active":"2024-04-16T12:57:19.895467+0000","last_peered":"2024-04-16T12:57:19.895467+0000","last_clean":"2024-04-16T12:57:19.895467+0000","last_became_active":"2024-04-16T12:57:17.900310+0000","last_became_peered":"2024-04-16T12:57:17.900310+0000","last_unstale":"2024-04-16T12:57:19.895467+0000","last_undegraded":"2024-04-16T12:57:19.895467+0000","last_fullsized":"2024-04-16T12:57:19.895467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223267+0000","last_change":"2024-04-16T12:57:18.902887+0000","last_active":"2024-04-16T12:57:20.223267+0000","last_peered":"2024-04-16T12:57:20.223267+0000","last_clean":"2024-04-16T12:57:20.223267+0000","last_became_active":"2024-04-16T12:57:18.902472+0000","last_became_peered":"2024-04-16T12:57:18.902472+0000","last_unstale":"2024-04-16T12:57:20.223267+0000","last_undegraded":"2024-04-16T12:57:20.223267+0000","last_fullsized":"2024-04-16T12:57:20.223267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:39:54.803079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.895602+0000","last_change":"2024-04-16T12:57:17.898164+0000","last_active":"2024-04-16T12:57:19.895602+0000","last_peered":"2024-04-16T12:57:19.895602+0000","last_clean":"2024-04-16T12:57:19.895602+0000","last_became_active":"2024-04-16T12:57:17.897830+0000","last_became_peered":"2024-04-16T12:57:17.897830+0000","last_unstale":"2024-04-16T12:57:19.895602+0000","last_undegraded":"2024-04-16T12:57:19.895602+0000","last_fullsized":"2024-04-16T12:57:19.895602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:32.984630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223680+0000","last_change":"2024-04-16T12:57:18.907229+0000","last_active":"2024-04-16T12:57:20.223680+0000","last_peered":"2024-04-16T12:57:20.223680+0000","last_clean":"2024-04-16T12:57:20.223680+0000","last_became_active":"2024-04-16T12:57:18.906470+0000","last_became_peered":"2024-04-16T12:57:18.906470+0000","last_unstale":"2024-04-16T12:57:20.223680+0000","last_undegraded":"2024-04-16T12:57:20.223680+0000","last_fullsized":"2024-04-16T12:57:20.223680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:05.084210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897038+0000","last_change":"2024-04-16T12:57:17.899164+0000","last_active":"2024-04-16T12:57:19.897038+0000","last_peered":"2024-04-16T12:57:19.897038+0000","last_clean":"2024-04-16T12:57:19.897038+0000","last_became_active":"2024-04-16T12:57:17.898085+0000","last_became_peered":"2024-04-16T12:57:17.898085+0000","last_unstale":"2024-04-16T12:57:19.897038+0000","last_undegraded":"2024-04-16T12:57:19.897038+0000","last_fullsized":"2024-04-16T12:57:19.897038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:18.716570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.900405+0000","last_change":"2024-04-16T12:57:18.902652+0000","last_active":"2024-04-16T12:57:19.900405+0000","last_peered":"2024-04-16T12:57:19.900405+0000","last_clean":"2024-04-16T12:57:19.900405+0000","last_became_active":"2024-04-16T12:57:18.902392+0000","last_became_peered":"2024-04-16T12:57:18.902392+0000","last_unstale":"2024-04-16T12:57:19.900405+0000","last_undegraded":"2024-04-16T12:57:19.900405+0000","last_fullsized":"2024-04-16T12:57:19.900405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896213+0000","last_change":"2024-04-16T12:57:18.898290+0000","last_active":"2024-04-16T12:57:19.896213+0000","last_peered":"2024-04-16T12:57:19.896213+0000","last_clean":"2024-04-16T12:57:19.896213+0000","last_became_active":"2024-04-16T12:57:18.897987+0000","last_became_peered":"2024-04-16T12:57:18.897987+0000","last_unstale":"2024-04-16T12:57:19.896213+0000","last_undegraded":"2024-04-16T12:57:19.896213+0000","last_fullsized":"2024-04-16T12:57:19.896213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:47:33.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897011+0000","last_change":"2024-04-16T12:57:17.897406+0000","last_active":"2024-04-16T12:57:19.897011+0000","last_peered":"2024-04-16T12:57:19.897011+0000","last_clean":"2024-04-16T12:57:19.897011+0000","last_became_active":"2024-04-16T12:57:17.897092+0000","last_became_peered":"2024-04-16T12:57:17.897092+0000","last_unstale":"2024-04-16T12:57:19.897011+0000","last_undegraded":"2024-04-16T12:57:19.897011+0000","last_fullsized":"2024-04-16T12:57:19.897011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:09:28.757384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.896453+0000","last_change":"2024-04-16T12:57:18.898875+0000","last_active":"2024-04-16T12:57:19.896453+0000","last_peered":"2024-04-16T12:57:19.896453+0000","last_clean":"2024-04-16T12:57:19.896453+0000","last_became_active":"2024-04-16T12:57:18.898620+0000","last_became_peered":"2024-04-16T12:57:18.898620+0000","last_unstale":"2024-04-16T12:57:19.896453+0000","last_undegraded":"2024-04-16T12:57:19.896453+0000","last_fullsized":"2024-04-16T12:57:19.896453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:16.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.897291+0000","last_change":"2024-04-16T12:57:17.893648+0000","last_active":"2024-04-16T12:57:19.897291+0000","last_peered":"2024-04-16T12:57:19.897291+0000","last_clean":"2024-04-16T12:57:19.897291+0000","last_became_active":"2024-04-16T12:57:17.893177+0000","last_became_peered":"2024-04-16T12:57:17.893177+0000","last_unstale":"2024-04-16T12:57:19.897291+0000","last_undegraded":"2024-04-16T12:57:19.897291+0000","last_fullsized":"2024-04-16T12:57:19.897291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:21:02.292438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997690+0000","last_change":"2024-04-16T12:57:18.897038+0000","last_active":"2024-04-16T12:57:19.997690+0000","last_peered":"2024-04-16T12:57:19.997690+0000","last_clean":"2024-04-16T12:57:19.997690+0000","last_became_active":"2024-04-16T12:57:18.896693+0000","last_became_peered":"2024-04-16T12:57:18.896693+0000","last_unstale":"2024-04-16T12:57:19.997690+0000","last_undegraded":"2024-04-16T12:57:19.997690+0000","last_fullsized":"2024-04-16T12:57:19.997690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:08.050684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223881+0000","last_change":"2024-04-16T12:57:17.905286+0000","last_active":"2024-04-16T12:57:20.223881+0000","last_peered":"2024-04-16T12:57:20.223881+0000","last_clean":"2024-04-16T12:57:20.223881+0000","last_became_active":"2024-04-16T12:57:17.904988+0000","last_became_peered":"2024-04-16T12:57:17.904988+0000","last_unstale":"2024-04-16T12:57:20.223881+0000","last_undegraded":"2024-04-16T12:57:20.223881+0000","last_fullsized":"2024-04-16T12:57:20.223881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:44.138685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:20.223821+0000","last_change":"2024-04-16T12:57:18.905616+0000","last_active":"2024-04-16T12:57:20.223821+0000","last_peered":"2024-04-16T12:57:20.223821+0000","last_clean":"2024-04-16T12:57:20.223821+0000","last_became_active":"2024-04-16T12:57:18.905328+0000","last_became_peered":"2024-04-16T12:57:18.905328+0000","last_unstale":"2024-04-16T12:57:20.223821+0000","last_undegraded":"2024-04-16T12:57:20.223821+0000","last_fullsized":"2024-04-16T12:57:20.223821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:17.875587+0000","last_clean_scrub_stamp":"2024-04-16T12:57:17.875587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:25.181616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T12:57:19.997793+0000","last_change":"2024-04-16T12:57:17.902362+0000","last_active":"2024-04-16T12:57:19.997793+0000","last_peered":"2024-04-16T12:57:19.997793+0000","last_clean":"2024-04-16T12:57:19.997793+0000","last_became_active":"2024-04-16T12:57:17.902091+0000","last_became_peered":"2024-04-16T12:57:17.902091+0000","last_unstale":"2024-04-16T12:57:19.997793+0000","last_undegraded":"2024-04-16T12:57:19.997793+0000","last_fullsized":"2024-04-16T12:57:19.997793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:16.870564+0000","last_clean_scrub_stamp":"2024-04-16T12:57:16.870564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:44.138685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:57:26.613 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T12:57:26.614 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-16T12:57:26.614 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-16T12:57:26.614 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-16T12:57:26.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.750+0000 7f94aef0e640 1 Processor -- start 2024-04-16T12:57:26.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.750+0000 7f94aef0e640 1 -- start start 2024-04-16T12:57:26.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94aef0e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94a809acd0 0x7f94a8148800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94aef0e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a809de50 0x7f94a8150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94aef0e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94a809b0b0 con 0x7f94a8148d40 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94aef0e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f94a806e5c0 con 0x7f94a809acd0 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94aef0e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94a809b670 con 0x7f94a809de50 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94accaa640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94a809acd0 0x7f94a8148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94a7fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f94a8148d40 0x7f94a809d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59402/0 (socket says 172.21.15.106:59402) 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94accaa640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94a809acd0 0x7f94a8148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42994/0 (socket says 172.21.15.106:42994) 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94a7fff640 1 -- 172.21.15.106:0/538941149 learned_addr learned my addr 172.21.15.106:0/538941149 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94ad4ab640 1 --2- 172.21.15.106:0/538941149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a809de50 0x7f94a8150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94accaa640 1 -- 172.21.15.106:0/538941149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a809de50 msgr2=0x7f94a8150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94accaa640 1 --2- 172.21.15.106:0/538941149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a809de50 0x7f94a8150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94accaa640 1 -- 172.21.15.106:0/538941149 >> v1:172.21.15.106:6789/0 conn(0x7f94a8148d40 legacy=0x7f94a809d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94accaa640 1 -- 172.21.15.106:0/538941149 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a809b950 con 0x7f94a809acd0 2024-04-16T12:57:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94a77fe640 1 -- 172.21.15.106:0/538941149 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867616442 0 0) 0x7f94a809b0b0 con 0x7f94a8148d40 2024-04-16T12:57:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.751+0000 7f94ad4ab640 1 --2- 172.21.15.106:0/538941149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a809de50 0x7f94a8150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.752+0000 7f94accaa640 1 --2- 172.21.15.106:0/538941149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809acd0 0x7f94a8148800 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94980097a0 tx=0x7f949802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c7b4379cf7c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.752+0000 7f94a77fe640 1 -- 172.21.15.106:0/538941149 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9498038070 con 0x7f94a809acd0 2024-04-16T12:57:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.752+0000 7f94a77fe640 1 -- 172.21.15.106:0/538941149 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9498031700 con 0x7f94a809acd0 2024-04-16T12:57:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.752+0000 7f94a77fe640 1 -- 172.21.15.106:0/538941149 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9498031ad0 con 0x7f94a809acd0 2024-04-16T12:57:26.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 -- 172.21.15.106:0/538941149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809acd0 msgr2=0x7f94a8148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 --2- 172.21.15.106:0/538941149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809acd0 0x7f94a8148800 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94980097a0 tx=0x7f949802b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 -- 172.21.15.106:0/538941149 shutdown_connections 2024-04-16T12:57:26.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 --2- 172.21.15.106:0/538941149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a809de50 0x7f94a8150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 --2- 172.21.15.106:0/538941149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809acd0 0x7f94a8148800 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 -- 172.21.15.106:0/538941149 >> 172.21.15.106:0/538941149 conn(0x7f94a80b5e30 msgr2=0x7f94a80b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 -- 172.21.15.106:0/538941149 shutdown_connections 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.753+0000 7f94aef0e640 1 -- 172.21.15.106:0/538941149 wait complete. 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.754+0000 7f94aef0e640 1 Processor -- start 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.754+0000 7f94aef0e640 1 -- start start 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.754+0000 7f94aef0e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94a809acd0 0x7f94a8072d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.754+0000 7f94aef0e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809de50 0x7f94a8070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94aef0e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a8148d40 0x7f94a8072240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94aef0e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f94a80b5930 con 0x7f94a809de50 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94aef0e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94a80b5180 con 0x7f94a809acd0 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94aef0e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94a80b5ab0 con 0x7f94a8148d40 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809de50 0x7f94a8070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809de50 0x7f94a8070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43004/0 (socket says 172.21.15.106:43004) 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 -- 172.21.15.106:0/1624098509 learned_addr learned my addr 172.21.15.106:0/1624098509 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94accaa640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94a809acd0 0x7f94a8072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94ad4ab640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a8148d40 0x7f94a8072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 -- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a8148d40 msgr2=0x7f94a8072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a8148d40 0x7f94a8072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 -- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94a809acd0 msgr2=0x7f94a8072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94a809acd0 0x7f94a8072d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 -- 172.21.15.106:0/1624098509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a80b0310 con 0x7f94a809de50 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94accaa640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94a809acd0 0x7f94a8072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a7fff640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809de50 0x7f94a8070f60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c410 tx=0x7f949c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a57fa640 1 -- 172.21.15.106:0/1624098509 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0074e0 con 0x7f94a809de50 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a57fa640 1 -- 172.21.15.106:0/1624098509 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949c0047e0 con 0x7f94a809de50 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94a57fa640 1 -- 172.21.15.106:0/1624098509 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c004bd0 con 0x7f94a809de50 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a80b0030 con 0x7f94a809de50 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.755+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a80af9a0 con 0x7f94a809de50 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.756+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a8068a90 con 0x7f94a809de50 2024-04-16T12:57:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.757+0000 7f94a57fa640 1 -- 172.21.15.106:0/1624098509 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f949c011070 con 0x7f94a809de50 2024-04-16T12:57:26.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.757+0000 7f94a57fa640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f949406c8f0 0x7f949406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:26.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.757+0000 7f94a57fa640 1 -- 172.21.15.106:0/1624098509 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f949c08b660 con 0x7f94a809de50 2024-04-16T12:57:26.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.757+0000 7f94accaa640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f949406c8f0 0x7f949406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:26.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.758+0000 7f94accaa640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f949406c8f0 0x7f949406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9498035000 tx=0x7f9498008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:26.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.761+0000 7f94a57fa640 1 -- 172.21.15.106:0/1624098509 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f949c00e280 con 0x7f94a809de50 2024-04-16T12:57:26.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.977+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f94a80b6620 con 0x7f94a809de50 2024-04-16T12:57:26.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.977+0000 7f94a57fa640 1 -- 172.21.15.106:0/1624098509 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f949c059b20 con 0x7f94a809de50 2024-04-16T12:57:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:26.979 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T12:57:26.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f949406c8f0 msgr2=0x7f949406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f949406c8f0 0x7f949406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9498035000 tx=0x7f9498008030 comp rx=0 tx=0).stop 2024-04-16T12:57:26.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809de50 msgr2=0x7f94a8070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:26.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809de50 0x7f94a8070f60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c410 tx=0x7f949c00c8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 shutdown_connections 2024-04-16T12:57:26.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f949406c8f0 0x7f949406edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94a8148d40 0x7f94a8072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94a809de50 0x7f94a8070f60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 --2- 172.21.15.106:0/1624098509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94a809acd0 0x7f94a8072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:26.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 >> 172.21.15.106:0/1624098509 conn(0x7f94a80b5e30 msgr2=0x7f94a8074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:26.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 shutdown_connections 2024-04-16T12:57:26.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:26.979+0000 7f94aef0e640 1 -- 172.21.15.106:0/1624098509 wait complete. 2024-04-16T12:57:26.992 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-16T12:57:26.992 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:27.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.092+0000 7fc349488640 1 Processor -- start 2024-04-16T12:57:27.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc349488640 1 -- start start 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc349488640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3440b63a0 0x7fc3440b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc349488640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc3441481c0 0x7fc3441418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc349488640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc344148640 0x7fc344141de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc349488640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc344148b70 con 0x7fc344148640 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc349488640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc3440b4bd0 con 0x7fc3441481c0 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc349488640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440b4eb0 con 0x7fc3440b63a0 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc3437fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc344148640 0x7fc344141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc3437fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc344148640 0x7fc344141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43006/0 (socket says 172.21.15.106:43006) 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.093+0000 7fc3437fe640 1 -- 172.21.15.106:0/2420804972 learned_addr learned my addr 172.21.15.106:0/2420804972 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc3427fc640 1 --2- 172.21.15.106:0/2420804972 >> v2:172.21.15.171:3300/0 conn(0x7fc3441481c0 0x7fc3441418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc342ffd640 1 --2- 172.21.15.106:0/2420804972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3440b63a0 0x7fc3440b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc3437fe640 1 -- 172.21.15.106:0/2420804972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3440b63a0 msgr2=0x7fc3440b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc3437fe640 1 --2- 172.21.15.106:0/2420804972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3440b63a0 0x7fc3440b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc3437fe640 1 -- 172.21.15.106:0/2420804972 >> v2:172.21.15.171:3300/0 conn(0x7fc3441481c0 msgr2=0x7fc3441418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc3437fe640 1 --2- 172.21.15.106:0/2420804972 >> v2:172.21.15.171:3300/0 conn(0x7fc3441481c0 0x7fc3441418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc3437fe640 1 -- 172.21.15.106:0/2420804972 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440b53d0 con 0x7fc344148640 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc3437fe640 1 --2- 172.21.15.106:0/2420804972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344148640 0x7fc344141de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3440bb150 tx=0x7fc33c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52e7a52280a18bd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.094+0000 7fc341ffb640 1 -- 172.21.15.106:0/2420804972 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c02c9e0 con 0x7fc344148640 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc341ffb640 1 -- 172.21.15.106:0/2420804972 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c02cb80 con 0x7fc344148640 2024-04-16T12:57:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc341ffb640 1 -- 172.21.15.106:0/2420804972 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0343f0 con 0x7fc344148640 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 -- 172.21.15.106:0/2420804972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344148640 msgr2=0x7fc344141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 --2- 172.21.15.106:0/2420804972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344148640 0x7fc344141de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3440bb150 tx=0x7fc33c02be40 comp rx=0 tx=0).stop 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 -- 172.21.15.106:0/2420804972 shutdown_connections 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 --2- 172.21.15.106:0/2420804972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344148640 0x7fc344141de0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 --2- 172.21.15.106:0/2420804972 >> v2:172.21.15.171:3300/0 conn(0x7fc3441481c0 0x7fc3441418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 --2- 172.21.15.106:0/2420804972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3440b63a0 0x7fc3440b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 -- 172.21.15.106:0/2420804972 >> 172.21.15.106:0/2420804972 conn(0x7fc344068080 msgr2=0x7fc3440bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 -- 172.21.15.106:0/2420804972 shutdown_connections 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.095+0000 7fc349488640 1 -- 172.21.15.106:0/2420804972 wait complete. 2024-04-16T12:57:27.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.096+0000 7fc349488640 1 Processor -- start 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.096+0000 7fc349488640 1 -- start start 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc349488640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440b63a0 0x7fc3441d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc349488640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3441481c0 0x7fc3441dd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc349488640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc344148640 0x7fc3441ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc349488640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440b5ad0 con 0x7fc3440b63a0 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc349488640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440b5950 con 0x7fc344148640 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc349488640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440b5c50 con 0x7fc3441481c0 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440b63a0 0x7fc3441d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440b63a0 0x7fc3441d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43008/0 (socket says 172.21.15.106:43008) 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 -- 172.21.15.106:0/3377095046 learned_addr learned my addr 172.21.15.106:0/3377095046 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc3427fc640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3441481c0 0x7fc3441dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc3437fe640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc344148640 0x7fc3441ddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 -- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3441481c0 msgr2=0x7fc3441dd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3441481c0 0x7fc3441dd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 -- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc344148640 msgr2=0x7fc3441ddc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc344148640 0x7fc3441ddc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 -- 172.21.15.106:0/3377095046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3441d2ef0 con 0x7fc3440b63a0 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.097+0000 7fc342ffd640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440b63a0 0x7fc3441d1b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00d800 tx=0x7fc32c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.098+0000 7fc33b7fe640 1 -- 172.21.15.106:0/3377095046 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00b6c0 con 0x7fc3440b63a0 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.098+0000 7fc33b7fe640 1 -- 172.21.15.106:0/3377095046 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c019070 con 0x7fc3440b63a0 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.098+0000 7fc33b7fe640 1 -- 172.21.15.106:0/3377095046 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00ba80 con 0x7fc3440b63a0 2024-04-16T12:57:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.098+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3441d31d0 con 0x7fc3440b63a0 2024-04-16T12:57:27.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.098+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3441cf780 con 0x7fc3440b63a0 2024-04-16T12:57:27.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.099+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc344068a90 con 0x7fc3440b63a0 2024-04-16T12:57:27.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.099+0000 7fc33b7fe640 1 -- 172.21.15.106:0/3377095046 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc32c00bc20 con 0x7fc3440b63a0 2024-04-16T12:57:27.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.099+0000 7fc33b7fe640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc32406c8f0 0x7fc32406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.100+0000 7fc33b7fe640 1 -- 172.21.15.106:0/3377095046 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc32c08be40 con 0x7fc3440b63a0 2024-04-16T12:57:27.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.100+0000 7fc3427fc640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc32406c8f0 0x7fc32406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.100+0000 7fc3427fc640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc32406c8f0 0x7fc32406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3441454f0 tx=0x7fc334008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.104+0000 7fc33b7fe640 1 -- 172.21.15.106:0/3377095046 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc32c059cb0 con 0x7fc3440b63a0 2024-04-16T12:57:27.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.279+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc344146910 con 0x7fc3440b63a0 2024-04-16T12:57:27.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.281+0000 7fc33b7fe640 1 -- 172.21.15.106:0/3377095046 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fc32c05dfb0 con 0x7fc3440b63a0 2024-04-16T12:57:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:27.283 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc32406c8f0 msgr2=0x7fc32406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc32406c8f0 0x7fc32406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3441454f0 tx=0x7fc334008040 comp rx=0 tx=0).stop 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440b63a0 msgr2=0x7fc3441d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440b63a0 0x7fc3441d1b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00d800 tx=0x7fc32c00dcc0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 shutdown_connections 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc32406c8f0 0x7fc32406edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc344148640 0x7fc3441ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3441481c0 0x7fc3441dd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 --2- 172.21.15.106:0/3377095046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440b63a0 0x7fc3441d1b70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 >> 172.21.15.106:0/3377095046 conn(0x7fc344068080 msgr2=0x7fc3440b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 shutdown_connections 2024-04-16T12:57:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.283+0000 7fc349488640 1 -- 172.21.15.106:0/3377095046 wait complete. 2024-04-16T12:57:27.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:27.296 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.400+0000 7f792ca77640 1 Processor -- start 2024-04-16T12:57:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.400+0000 7f792ca77640 1 -- start start 2024-04-16T12:57:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.400+0000 7f792ca77640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f79280b7870 0x7f7928149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f792ca77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f79281499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f792ca77640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f792813c8b0 con 0x7f79280b7490 2024-04-16T12:57:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f792ca77640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f79280b3920 con 0x7f79280b7870 2024-04-16T12:57:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f792ca77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f79280b3640 con 0x7f7928145f60 2024-04-16T12:57:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f792659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f79280b7490 0x7f792813c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59408/0 (socket says 172.21.15.106:59408) 2024-04-16T12:57:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f792659c640 1 -- 172.21.15.106:0/3907005755 learned_addr learned my addr 172.21.15.106:0/3907005755 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f791dd9b640 1 --2- 172.21.15.106:0/3907005755 >> v2:172.21.15.171:3300/0 conn(0x7f79280b7870 0x7f7928149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f7926d9d640 1 --2- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f79281499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f7925d9b640 1 -- 172.21.15.106:0/3907005755 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321137932 0 0) 0x7f792813c8b0 con 0x7f79280b7490 2024-04-16T12:57:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f7925d9b640 1 -- 172.21.15.106:0/3907005755 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7914003520 con 0x7f79280b7490 2024-04-16T12:57:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f791dd9b640 1 -- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 msgr2=0x7f79281499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f791dd9b640 1 --2- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f79281499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f791dd9b640 1 -- 172.21.15.106:0/3907005755 >> v1:172.21.15.106:6789/0 conn(0x7f79280b7490 legacy=0x7f792813c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f791dd9b640 1 -- 172.21.15.106:0/3907005755 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79281464e0 con 0x7f79280b7870 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.401+0000 7f7926d9d640 1 --2- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f79281499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.402+0000 7f791dd9b640 1 --2- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7870 0x7f7928149480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f79100097a0 tx=0x7f791002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e11ac443442ebd67 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.402+0000 7f7925d9b640 1 -- 172.21.15.106:0/3907005755 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910031780 con 0x7f79280b7870 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.402+0000 7f7925d9b640 1 -- 172.21.15.106:0/3907005755 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7910037070 con 0x7f79280b7870 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.402+0000 7f7925d9b640 1 -- 172.21.15.106:0/3907005755 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910031b40 con 0x7f79280b7870 2024-04-16T12:57:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 -- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7870 msgr2=0x7f7928149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 --2- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7870 0x7f7928149480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f79100097a0 tx=0x7f791002b820 comp rx=0 tx=0).stop 2024-04-16T12:57:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 -- 172.21.15.106:0/3907005755 shutdown_connections 2024-04-16T12:57:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 --2- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f79281499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 --2- 172.21.15.106:0/3907005755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7870 0x7f7928149480 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 -- 172.21.15.106:0/3907005755 >> 172.21.15.106:0/3907005755 conn(0x7f79280b7e90 msgr2=0x7f79280b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 -- 172.21.15.106:0/3907005755 shutdown_connections 2024-04-16T12:57:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.403+0000 7f792ca77640 1 -- 172.21.15.106:0/3907005755 wait complete. 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.404+0000 7f792ca77640 1 Processor -- start 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.404+0000 7f792ca77640 1 -- start start 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7490 0x7f7928145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79280b7870 0x7f7928142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f792813a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79281503c0 con 0x7f79280b7870 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7928140050 con 0x7f79280b7490 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7928150540 con 0x7f7928145f60 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79280b7870 0x7f7928142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79280b7870 0x7f7928142910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43020/0 (socket says 172.21.15.106:43020) 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 -- 172.21.15.106:0/2127177520 learned_addr learned my addr 172.21.15.106:0/2127177520 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792659c640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7490 0x7f7928145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f7926d9d640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f792813a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 -- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 msgr2=0x7f792813a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f792813a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 -- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7490 msgr2=0x7f7928145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7490 0x7f7928145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 -- 172.21.15.106:0/2127177520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792806e680 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791dd9b640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79280b7870 0x7f7928142910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79100098c0 tx=0x7f79100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791f7fe640 1 -- 172.21.15.106:0/2127177520 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910032610 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791f7fe640 1 -- 172.21.15.106:0/2127177520 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7910031ec0 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f791f7fe640 1 -- 172.21.15.106:0/2127177520 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910032a10 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792806e960 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.405+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792814fad0 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.406+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792806c210 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.407+0000 7f791f7fe640 1 -- 172.21.15.106:0/2127177520 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7910032bb0 con 0x7f79280b7870 2024-04-16T12:57:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.407+0000 7f791f7fe640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f790806c8f0 0x7f790806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.407+0000 7f791f7fe640 1 -- 172.21.15.106:0/2127177520 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f79100ad680 con 0x7f79280b7870 2024-04-16T12:57:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.407+0000 7f792659c640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f790806c8f0 0x7f790806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.408+0000 7f792659c640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f790806c8f0 0x7f790806edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7918005880 tx=0x7f7918009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.412+0000 7f791f7fe640 1 -- 172.21.15.106:0/2127177520 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7910040070 con 0x7f79280b7870 2024-04-16T12:57:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.588+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7928068a90 con 0x7f79280b7870 2024-04-16T12:57:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.588+0000 7f791f7fe640 1 -- 172.21.15.106:0/2127177520 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f791002f050 con 0x7f79280b7870 2024-04-16T12:57:27.590 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f790806c8f0 msgr2=0x7f790806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f790806c8f0 0x7f790806edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7918005880 tx=0x7f7918009040 comp rx=0 tx=0).stop 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79280b7870 msgr2=0x7f7928142910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79280b7870 0x7f7928142910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79100098c0 tx=0x7f79100046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 shutdown_connections 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f790806c8f0 0x7f790806edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7928145f60 0x7f792813a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79280b7870 0x7f7928142910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 --2- 172.21.15.106:0/2127177520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79280b7490 0x7f7928145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 >> 172.21.15.106:0/2127177520 conn(0x7f79280b7e90 msgr2=0x7f7928072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 shutdown_connections 2024-04-16T12:57:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.590+0000 7f792ca77640 1 -- 172.21.15.106:0/2127177520 wait complete. 2024-04-16T12:57:27.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:27.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 Processor -- start 2024-04-16T12:57:27.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 -- start start 2024-04-16T12:57:27.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79380b52c0 0x7f79380b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79380b4760 0x7f79381486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7938148c30 0x7f7938149400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f79380b72c0 con 0x7f79380b52c0 2024-04-16T12:57:27.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f79380b4ba0 con 0x7f7938148c30 2024-04-16T12:57:27.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f793d146640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f79380b3d80 con 0x7f79380b4760 2024-04-16T12:57:27.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f7936d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79380b52c0 0x7f79380b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f7936d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79380b52c0 0x7f79380b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43036/0 (socket says 172.21.15.106:43036) 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.707+0000 7f7936d9d640 1 -- 172.21.15.106:0/2140986909 learned_addr learned my addr 172.21.15.106:0/2140986909 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f793759e640 1 --2- 172.21.15.106:0/2140986909 >> v2:172.21.15.171:3300/0 conn(0x7f7938148c30 0x7f7938149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f793659c640 1 --2- 172.21.15.106:0/2140986909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79380b4760 0x7f79381486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f7936d9d640 1 -- 172.21.15.106:0/2140986909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79380b4760 msgr2=0x7f79381486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f7936d9d640 1 --2- 172.21.15.106:0/2140986909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79380b4760 0x7f79381486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f7936d9d640 1 -- 172.21.15.106:0/2140986909 >> v2:172.21.15.171:3300/0 conn(0x7f7938148c30 msgr2=0x7f7938149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f7936d9d640 1 --2- 172.21.15.106:0/2140986909 >> v2:172.21.15.171:3300/0 conn(0x7f7938148c30 0x7f7938149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f7936d9d640 1 -- 172.21.15.106:0/2140986909 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79380b7da0 con 0x7f79380b52c0 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f793759e640 1 --2- 172.21.15.106:0/2140986909 >> v2:172.21.15.171:3300/0 conn(0x7f7938148c30 0x7f7938149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.708+0000 7f7936d9d640 1 --2- 172.21.15.106:0/2140986909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79380b29e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f79380b3720 tx=0x7f792802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f061ba4f7e9a5230 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f7935d9b640 1 -- 172.21.15.106:0/2140986909 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792802e070 con 0x7f79380b52c0 2024-04-16T12:57:27.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f7935d9b640 1 -- 172.21.15.106:0/2140986909 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7928037070 con 0x7f79380b52c0 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f7935d9b640 1 -- 172.21.15.106:0/2140986909 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928031a00 con 0x7f79380b52c0 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 -- 172.21.15.106:0/2140986909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 msgr2=0x7f79380b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 --2- 172.21.15.106:0/2140986909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79380b29e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f79380b3720 tx=0x7f792802b880 comp rx=0 tx=0).stop 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 -- 172.21.15.106:0/2140986909 shutdown_connections 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 --2- 172.21.15.106:0/2140986909 >> v2:172.21.15.171:3300/0 conn(0x7f7938148c30 0x7f7938149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 --2- 172.21.15.106:0/2140986909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79380b4760 0x7f79381486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 --2- 172.21.15.106:0/2140986909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79380b29e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 -- 172.21.15.106:0/2140986909 >> 172.21.15.106:0/2140986909 conn(0x7f7938067fe0 msgr2=0x7f79380bb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 -- 172.21.15.106:0/2140986909 shutdown_connections 2024-04-16T12:57:27.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.709+0000 7f793d146640 1 -- 172.21.15.106:0/2140986909 wait complete. 2024-04-16T12:57:27.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.710+0000 7f793d146640 1 Processor -- start 2024-04-16T12:57:27.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793d146640 1 -- start start 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793d146640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79380b4760 0x7f79380a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793d146640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79381db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793d146640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7938148c30 0x7f79381d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793d146640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79381490c0 con 0x7f79380b52c0 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793d146640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79380bbec0 con 0x7f79380b4760 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793d146640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f79380b5de0 con 0x7f7938148c30 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79381db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79381db6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43038/0 (socket says 172.21.15.106:43038) 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 -- 172.21.15.106:0/2392680502 learned_addr learned my addr 172.21.15.106:0/2392680502 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f7936d9d640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79380b4760 0x7f79380a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793759e640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7938148c30 0x7f79381d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 -- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7938148c30 msgr2=0x7f79381d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7938148c30 0x7f79381d19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 -- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79380b4760 msgr2=0x7f79380a9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79380b4760 0x7f79380a9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.711+0000 7f793659c640 1 -- 172.21.15.106:0/2392680502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79381d06f0 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.712+0000 7f793659c640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79381db6d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f792c00e890 tx=0x7f792c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.712+0000 7f791f7fe640 1 -- 172.21.15.106:0/2392680502 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c017070 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.712+0000 7f791f7fe640 1 -- 172.21.15.106:0/2392680502 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c00c940 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.712+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79380ab400 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.712+0000 7f791f7fe640 1 -- 172.21.15.106:0/2392680502 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c00cd10 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.712+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79380a94d0 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.713+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79380b7770 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.713+0000 7f791f7fe640 1 -- 172.21.15.106:0/2392680502 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f792c01a070 con 0x7f79380b52c0 2024-04-16T12:57:27.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.714+0000 7f791f7fe640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f792406c920 0x7f792406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:27.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.714+0000 7f7936d9d640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f792406c920 0x7f792406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:27.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.714+0000 7f791f7fe640 1 -- 172.21.15.106:0/2392680502 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f792c08bab0 con 0x7f79380b52c0 2024-04-16T12:57:27.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.714+0000 7f7936d9d640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f792406c920 0x7f792406ede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7928036000 tx=0x7f792803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:27.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.718+0000 7f791f7fe640 1 -- 172.21.15.106:0/2392680502 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79380b7770 con 0x7f79380b52c0 2024-04-16T12:57:27.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.892+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79381d12b0 con 0x7f79380b52c0 2024-04-16T12:57:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.893+0000 7f791f7fe640 1 -- 172.21.15.106:0/2392680502 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f792c059ef0 con 0x7f79380b52c0 2024-04-16T12:57:27.895 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f792406c920 msgr2=0x7f792406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f792406c920 0x7f792406ede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7928036000 tx=0x7f792803d040 comp rx=0 tx=0).stop 2024-04-16T12:57:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 msgr2=0x7f79381db6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79381db6d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f792c00e890 tx=0x7f792c00ed50 comp rx=0 tx=0).stop 2024-04-16T12:57:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 shutdown_connections 2024-04-16T12:57:27.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f792406c920 0x7f792406ede0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7938148c30 0x7f79381d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79380b52c0 0x7f79381db6d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 --2- 172.21.15.106:0/2392680502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79380b4760 0x7f79380a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:27.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.894+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 >> 172.21.15.106:0/2392680502 conn(0x7f7938067fe0 msgr2=0x7f79380ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:27.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.895+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 shutdown_connections 2024-04-16T12:57:27.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:27.895+0000 7f793d146640 1 -- 172.21.15.106:0/2392680502 wait complete. 2024-04-16T12:57:27.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:28.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.011+0000 7faa3682c640 1 Processor -- start 2024-04-16T12:57:28.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.011+0000 7faa3682c640 1 -- start start 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa3682c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faa300b7870 0x7faa30149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa3682c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa30145f60 0x7faa301499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa3682c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa3013c8b0 con 0x7faa300b7490 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa3682c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faa300b3920 con 0x7faa300b7870 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa3682c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa300b3640 con 0x7faa30145f60 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa34dc9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa30145f60 0x7faa301499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa27fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faa300b7870 0x7faa30149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa34dc9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa30145f60 0x7faa301499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46444/0 (socket says 172.21.15.106:46444) 2024-04-16T12:57:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa2ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7faa300b7490 0x7faa3013c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:33680/0 (socket says 172.21.15.106:33680) 2024-04-16T12:57:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.012+0000 7faa34dc9640 1 -- 172.21.15.106:0/1841962528 learned_addr learned my addr 172.21.15.106:0/1841962528 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.013+0000 7faa34dc9640 1 -- 172.21.15.106:0/1841962528 >> v2:172.21.15.171:3300/0 conn(0x7faa300b7870 msgr2=0x7faa30149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.013+0000 7faa34dc9640 1 --2- 172.21.15.106:0/1841962528 >> v2:172.21.15.171:3300/0 conn(0x7faa300b7870 0x7faa30149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.013+0000 7faa34dc9640 1 -- 172.21.15.106:0/1841962528 >> v1:172.21.15.171:6789/0 conn(0x7faa300b7490 legacy=0x7faa3013c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.013+0000 7faa34dc9640 1 -- 172.21.15.106:0/1841962528 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa301464e0 con 0x7faa30145f60 2024-04-16T12:57:28.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.013+0000 7faa34dc9640 1 --2- 172.21.15.106:0/1841962528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa30145f60 0x7faa301499c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faa28009e50 tx=0x7faa2802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=805a64f55bccdd05 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa2f7fe640 1 -- 172.21.15.106:0/1841962528 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2802ca70 con 0x7faa30145f60 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa2f7fe640 1 -- 172.21.15.106:0/1841962528 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2802cc10 con 0x7faa30145f60 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa2f7fe640 1 -- 172.21.15.106:0/1841962528 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280343f0 con 0x7faa30145f60 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 -- 172.21.15.106:0/1841962528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa30145f60 msgr2=0x7faa301499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 --2- 172.21.15.106:0/1841962528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa30145f60 0x7faa301499c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faa28009e50 tx=0x7faa2802bed0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 -- 172.21.15.106:0/1841962528 shutdown_connections 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 --2- 172.21.15.106:0/1841962528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa30145f60 0x7faa301499c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 --2- 172.21.15.106:0/1841962528 >> v2:172.21.15.171:3300/0 conn(0x7faa300b7870 0x7faa30149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 -- 172.21.15.106:0/1841962528 >> 172.21.15.106:0/1841962528 conn(0x7faa300b7e90 msgr2=0x7faa300b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 -- 172.21.15.106:0/1841962528 shutdown_connections 2024-04-16T12:57:28.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.014+0000 7faa3682c640 1 -- 172.21.15.106:0/1841962528 wait complete. 2024-04-16T12:57:28.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.015+0000 7faa3682c640 1 Processor -- start 2024-04-16T12:57:28.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.015+0000 7faa3682c640 1 -- start start 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa3682c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa300b7490 0x7faa30141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa3682c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa300b7870 0x7faa30139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa3682c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa30145f60 0x7faa3013a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa3682c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa301503c0 con 0x7faa300b7870 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa3682c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa30140050 con 0x7faa30145f60 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa3682c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa30150540 con 0x7faa300b7490 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa300b7870 0x7faa30139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa300b7870 0x7faa30139dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43052/0 (socket says 172.21.15.106:43052) 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 -- 172.21.15.106:0/1995886920 learned_addr learned my addr 172.21.15.106:0/1995886920 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa2ffff640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa300b7490 0x7faa30141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa34dc9640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa30145f60 0x7faa3013a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 -- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa300b7490 msgr2=0x7faa30141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa300b7490 0x7faa30141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 -- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa30145f60 msgr2=0x7faa3013a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa30145f60 0x7faa3013a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 -- 172.21.15.106:0/1995886920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa30135470 con 0x7faa300b7870 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa27fff640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa300b7870 0x7faa30139dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa1800e980 tx=0x7faa1800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.016+0000 7faa2d7fa640 1 -- 172.21.15.106:0/1995886920 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18017070 con 0x7faa300b7870 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.017+0000 7faa2d7fa640 1 -- 172.21.15.106:0/1995886920 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1800ca00 con 0x7faa300b7870 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.017+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa30135750 con 0x7faa300b7870 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.017+0000 7faa2d7fa640 1 -- 172.21.15.106:0/1995886920 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1800cdd0 con 0x7faa300b7870 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.017+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa301398b0 con 0x7faa300b7870 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.017+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3006c210 con 0x7faa300b7870 2024-04-16T12:57:28.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.018+0000 7faa2d7fa640 1 -- 172.21.15.106:0/1995886920 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa1801a070 con 0x7faa300b7870 2024-04-16T12:57:28.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.018+0000 7faa2d7fa640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faa1006c8f0 0x7faa1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.019+0000 7faa2ffff640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faa1006c8f0 0x7faa1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.019+0000 7faa2d7fa640 1 -- 172.21.15.106:0/1995886920 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa1808ba10 con 0x7faa300b7870 2024-04-16T12:57:28.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.019+0000 7faa2ffff640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faa1006c8f0 0x7faa1006edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa30148ea0 tx=0x7faa20007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.023+0000 7faa2d7fa640 1 -- 172.21.15.106:0/1995886920 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa18059880 con 0x7faa300b7870 2024-04-16T12:57:28.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.200+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faa30073600 con 0x7faa300b7870 2024-04-16T12:57:28.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.200+0000 7faa2d7fa640 1 -- 172.21.15.106:0/1995886920 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7faa1805db80 con 0x7faa300b7870 2024-04-16T12:57:28.202 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faa1006c8f0 msgr2=0x7faa1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faa1006c8f0 0x7faa1006edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa30148ea0 tx=0x7faa20007e80 comp rx=0 tx=0).stop 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa300b7870 msgr2=0x7faa30139dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa300b7870 0x7faa30139dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa1800e980 tx=0x7faa1800ee40 comp rx=0 tx=0).stop 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 shutdown_connections 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faa1006c8f0 0x7faa1006edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa30145f60 0x7faa3013a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa300b7870 0x7faa30139dd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 --2- 172.21.15.106:0/1995886920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa300b7490 0x7faa30141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 >> 172.21.15.106:0/1995886920 conn(0x7faa300b7e90 msgr2=0x7faa30072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 shutdown_connections 2024-04-16T12:57:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.202+0000 7faa3682c640 1 -- 172.21.15.106:0/1995886920 wait complete. 2024-04-16T12:57:28.214 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:28.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.315+0000 7f407b69a640 1 Processor -- start 2024-04-16T12:57:28.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f407b69a640 1 -- start start 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f407b69a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f407406db00 0x7f40740b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f407b69a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f40741481b0 0x7f40741485f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f407b69a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40740b44c0 con 0x7f4074148b30 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f407b69a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f40740ae4c0 con 0x7f40741481b0 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f407b69a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f407406dee0 con 0x7f407406db00 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f4078c35640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f40741481b0 0x7f40741485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f4078c35640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f40741481b0 0x7f40741485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43054/0 (socket says 172.21.15.106:43054) 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.316+0000 7f4078c35640 1 -- 172.21.15.106:0/1085421766 learned_addr learned my addr 172.21.15.106:0/1085421766 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.317+0000 7f4079436640 1 --2- 172.21.15.106:0/1085421766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f407406db00 0x7f40740b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.317+0000 7f4078c35640 1 -- 172.21.15.106:0/1085421766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f407406db00 msgr2=0x7f40740b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:28.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.317+0000 7f4078c35640 1 --2- 172.21.15.106:0/1085421766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f407406db00 0x7f40740b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.317+0000 7f4078c35640 1 -- 172.21.15.106:0/1085421766 >> v1:172.21.15.171:6789/0 conn(0x7f4074148b30 legacy=0x7f4074144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.317+0000 7f4078c35640 1 -- 172.21.15.106:0/1085421766 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4074148fa0 con 0x7f40741481b0 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.317+0000 7f4078c35640 1 --2- 172.21.15.106:0/1085421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40741481b0 0x7f40741485f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4070009870 tx=0x7f407002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c38dd1e4197eb83 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f406bfff640 1 -- 172.21.15.106:0/1085421766 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4070035020 con 0x7f40741481b0 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f406bfff640 1 -- 172.21.15.106:0/1085421766 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4070031640 con 0x7f40741481b0 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f406bfff640 1 -- 172.21.15.106:0/1085421766 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407002d040 con 0x7f40741481b0 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 -- 172.21.15.106:0/1085421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40741481b0 msgr2=0x7f40741485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 --2- 172.21.15.106:0/1085421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40741481b0 0x7f40741485f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4070009870 tx=0x7f407002b8f0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 -- 172.21.15.106:0/1085421766 shutdown_connections 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 --2- 172.21.15.106:0/1085421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40741481b0 0x7f40741485f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 --2- 172.21.15.106:0/1085421766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f407406db00 0x7f40740b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 -- 172.21.15.106:0/1085421766 >> 172.21.15.106:0/1085421766 conn(0x7f407409cc10 msgr2=0x7f407406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:28.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 -- 172.21.15.106:0/1085421766 shutdown_connections 2024-04-16T12:57:28.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.318+0000 7f407b69a640 1 -- 172.21.15.106:0/1085421766 wait complete. 2024-04-16T12:57:28.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.319+0000 7f407b69a640 1 Processor -- start 2024-04-16T12:57:28.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.319+0000 7f407b69a640 1 -- start start 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f407b69a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f407406db00 0x7f4074072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f407b69a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40741481b0 0x7f40741db450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f407b69a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4074148b30 0x7f40741db990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f407b69a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40740b4e20 con 0x7f407406db00 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f407b69a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40740aea80 con 0x7f4074148b30 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f407b69a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40740b5100 con 0x7f40741481b0 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f407406db00 0x7f4074072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f407406db00 0x7f4074072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43066/0 (socket says 172.21.15.106:43066) 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 -- 172.21.15.106:0/3516413110 learned_addr learned my addr 172.21.15.106:0/3516413110 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079c37640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4074148b30 0x7f40741db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4078c35640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40741481b0 0x7f40741db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 -- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40741481b0 msgr2=0x7f40741db450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40741481b0 0x7f40741db450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 -- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4074148b30 msgr2=0x7f40741db990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4074148b30 0x7f40741db990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 -- 172.21.15.106:0/3516413110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40740b1c70 con 0x7f407406db00 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079c37640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4074148b30 0x7f40741db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4078c35640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40741481b0 0x7f40741db450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4079436640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f407406db00 0x7f4074072490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f406400d830 tx=0x7f406400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4069ffb640 1 -- 172.21.15.106:0/3516413110 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406400b6c0 con 0x7f407406db00 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4069ffb640 1 -- 172.21.15.106:0/3516413110 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4064019070 con 0x7f407406db00 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40740b1990 con 0x7f407406db00 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.320+0000 7f4069ffb640 1 -- 172.21.15.106:0/3516413110 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406400bac0 con 0x7f407406db00 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.321+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407413b7e0 con 0x7f407406db00 2024-04-16T12:57:28.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.322+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4074068a90 con 0x7f407406db00 2024-04-16T12:57:28.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.322+0000 7f4069ffb640 1 -- 172.21.15.106:0/3516413110 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f406401e460 con 0x7f407406db00 2024-04-16T12:57:28.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.323+0000 7f4069ffb640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f405806c8f0 0x7f405806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.323+0000 7f4078c35640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f405806c8f0 0x7f405806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.323+0000 7f4069ffb640 1 -- 172.21.15.106:0/3516413110 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f406408c1e0 con 0x7f407406db00 2024-04-16T12:57:28.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.323+0000 7f4078c35640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f405806c8f0 0x7f405806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4070036000 tx=0x7f407003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.327+0000 7f4069ffb640 1 -- 172.21.15.106:0/3516413110 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f40740b1c70 con 0x7f407406db00 2024-04-16T12:57:28.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.539+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f407413be30 con 0x7f407406db00 2024-04-16T12:57:28.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.539+0000 7f4069ffb640 1 -- 172.21.15.106:0/3516413110 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f406405a6a0 con 0x7f407406db00 2024-04-16T12:57:28.541 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:28.541 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:28.541 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:28.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f405806c8f0 msgr2=0x7f405806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f405806c8f0 0x7f405806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4070036000 tx=0x7f407003c040 comp rx=0 tx=0).stop 2024-04-16T12:57:28.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f407406db00 msgr2=0x7f4074072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f407406db00 0x7f4074072490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f406400d830 tx=0x7f406400dcf0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 shutdown_connections 2024-04-16T12:57:28.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f405806c8f0 0x7f405806edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4074148b30 0x7f40741db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40741481b0 0x7f40741db450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 --2- 172.21.15.106:0/3516413110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f407406db00 0x7f4074072490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 >> 172.21.15.106:0/3516413110 conn(0x7f407409cc10 msgr2=0x7f407406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:28.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 shutdown_connections 2024-04-16T12:57:28.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.541+0000 7f407b69a640 1 -- 172.21.15.106:0/3516413110 wait complete. 2024-04-16T12:57:28.554 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:28.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.654+0000 7f4b15959640 1 Processor -- start 2024-04-16T12:57:28.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.654+0000 7f4b15959640 1 -- start start 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b15959640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b1009ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b15959640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4b101480c0 0x7f4b10148530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b15959640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b10148a70 con 0x7f4b100b65b0 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b15959640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1009bf70 con 0x7f4b101480c0 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b15959640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1009b6f0 con 0x7f4b10073940 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4b101480c0 0x7f4b10148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4b101480c0 0x7f4b10148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43076/0 (socket says 172.21.15.106:43076) 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/1850257382 learned_addr learned my addr 172.21.15.106:0/1850257382 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0effd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4b100b65b0 0x7f4b10145030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59422/0 (socket says 172.21.15.106:59422) 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0e7fc640 1 --2- 172.21.15.106:0/1850257382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b1009ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/1850257382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 msgr2=0x7f4b1009ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0f7fe640 1 --2- 172.21.15.106:0/1850257382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b1009ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.655+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/1850257382 >> v1:172.21.15.106:6789/0 conn(0x7f4b100b65b0 legacy=0x7f4b10145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.656+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/1850257382 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b100b6990 con 0x7f4b101480c0 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.656+0000 7f4b0e7fc640 1 --2- 172.21.15.106:0/1850257382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b1009ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.656+0000 7f4b0f7fe640 1 --2- 172.21.15.106:0/1850257382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10148530 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009870 tx=0x7f4b0802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c9a47ff37a8517 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.656+0000 7f4b0dffb640 1 -- 172.21.15.106:0/1850257382 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08034070 con 0x7f4b101480c0 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.656+0000 7f4b0dffb640 1 -- 172.21.15.106:0/1850257382 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b08030840 con 0x7f4b101480c0 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.656+0000 7f4b0dffb640 1 -- 172.21.15.106:0/1850257382 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08030c10 con 0x7f4b101480c0 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 -- 172.21.15.106:0/1850257382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 msgr2=0x7f4b10148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 --2- 172.21.15.106:0/1850257382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10148530 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009870 tx=0x7f4b0802b980 comp rx=0 tx=0).stop 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 -- 172.21.15.106:0/1850257382 shutdown_connections 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 --2- 172.21.15.106:0/1850257382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10148530 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 --2- 172.21.15.106:0/1850257382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b1009ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 -- 172.21.15.106:0/1850257382 >> 172.21.15.106:0/1850257382 conn(0x7f4b1009c370 msgr2=0x7f4b1009c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 -- 172.21.15.106:0/1850257382 shutdown_connections 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.657+0000 7f4b15959640 1 -- 172.21.15.106:0/1850257382 wait complete. 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.658+0000 7f4b15959640 1 Processor -- start 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.658+0000 7f4b15959640 1 -- start start 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b15959640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b101415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b15959640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b100b65b0 0x7f4b10072a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b15959640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b15959640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4b101458c0 con 0x7f4b101480c0 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b15959640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10145740 con 0x7f4b100b65b0 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b15959640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4b10152740 con 0x7f4b10073940 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43082/0 (socket says 172.21.15.106:43082) 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/4205181281 learned_addr learned my addr 172.21.15.106:0/4205181281 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0e7fc640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b100b65b0 0x7f4b10072a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0effd640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b101415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 msgr2=0x7f4b101415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b101415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b100b65b0 msgr2=0x7f4b10072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b100b65b0 0x7f4b10072a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 -- 172.21.15.106:0/4205181281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b10141b00 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b0f7fe640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10142c20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009870 tx=0x7f4b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b07fff640 1 -- 172.21.15.106:0/4205181281 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08034040 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b07fff640 1 -- 172.21.15.106:0/4205181281 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b08039d90 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.659+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b10141dd0 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.660+0000 7f4b07fff640 1 -- 172.21.15.106:0/4205181281 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08043610 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.660+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b100732a0 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.661+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b10142590 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.661+0000 7f4b07fff640 1 -- 172.21.15.106:0/4205181281 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b0804a060 con 0x7f4b101480c0 2024-04-16T12:57:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.661+0000 7f4b07fff640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4af006c8f0 0x7f4af006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.661+0000 7f4b07fff640 1 -- 172.21.15.106:0/4205181281 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b080adb80 con 0x7f4b101480c0 2024-04-16T12:57:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.661+0000 7f4b0effd640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4af006c8f0 0x7f4af006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.662+0000 7f4b0effd640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4af006c8f0 0x7f4af006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b00007fd0 tx=0x7f4b000016d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.666+0000 7f4b07fff640 1 -- 172.21.15.106:0/4205181281 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b10142590 con 0x7f4b101480c0 2024-04-16T12:57:28.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.841+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b100691a0 con 0x7f4b101480c0 2024-04-16T12:57:28.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.842+0000 7f4b07fff640 1 -- 172.21.15.106:0/4205181281 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f4b0803e070 con 0x7f4b101480c0 2024-04-16T12:57:28.844 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:28.844 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:28.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4af006c8f0 msgr2=0x7f4af006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4af006c8f0 0x7f4af006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b00007fd0 tx=0x7f4b000016d0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 msgr2=0x7f4b10142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10142c20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009870 tx=0x7f4b080046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 shutdown_connections 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4af006c8f0 0x7f4af006edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b101480c0 0x7f4b10142c20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b100b65b0 0x7f4b10072a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 --2- 172.21.15.106:0/4205181281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b10073940 0x7f4b101415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 >> 172.21.15.106:0/4205181281 conn(0x7f4b1009c370 msgr2=0x7f4b1006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 shutdown_connections 2024-04-16T12:57:28.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.844+0000 7f4b15959640 1 -- 172.21.15.106:0/4205181281 wait complete. 2024-04-16T12:57:28.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:28.858 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:28.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.964+0000 7f4d9c80d640 1 Processor -- start 2024-04-16T12:57:28.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.964+0000 7f4d9c80d640 1 -- start start 2024-04-16T12:57:28.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.964+0000 7f4d9c80d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98141910 0x7f4d98141d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.964+0000 7f4d9c80d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d98070e00 0x7f4d98071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.964+0000 7f4d9c80d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d980731f0 con 0x7f4d98072e10 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.964+0000 7f4d9c80d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4d980afe50 con 0x7f4d98070e00 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.964+0000 7f4d9c80d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4d980b5400 con 0x7f4d98141910 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d96d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d98070e00 0x7f4d98071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d96d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d98070e00 0x7f4d98071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43084/0 (socket says 172.21.15.106:43084) 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d96d9d640 1 -- 172.21.15.106:0/1792220207 learned_addr learned my addr 172.21.15.106:0/1792220207 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d95d9b640 1 --2- 172.21.15.106:0/1792220207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98141910 0x7f4d98141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d96d9d640 1 -- 172.21.15.106:0/1792220207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98141910 msgr2=0x7f4d98141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d96d9d640 1 --2- 172.21.15.106:0/1792220207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98141910 0x7f4d98141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d96d9d640 1 -- 172.21.15.106:0/1792220207 >> v1:172.21.15.171:6789/0 conn(0x7f4d98072e10 legacy=0x7f4d980b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.965+0000 7f4d96d9d640 1 -- 172.21.15.106:0/1792220207 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d980b56e0 con 0x7f4d98070e00 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d96d9d640 1 --2- 172.21.15.106:0/1792220207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d98071290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009e50 tx=0x7f4d9002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe75b598c9f7a060 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9559a640 1 -- 172.21.15.106:0/1792220207 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9002c9e0 con 0x7f4d98070e00 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9559a640 1 -- 172.21.15.106:0/1792220207 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9002cb80 con 0x7f4d98070e00 2024-04-16T12:57:28.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9559a640 1 -- 172.21.15.106:0/1792220207 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d900343f0 con 0x7f4d98070e00 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 -- 172.21.15.106:0/1792220207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 msgr2=0x7f4d98071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/1792220207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d98071290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009e50 tx=0x7f4d9002be40 comp rx=0 tx=0).stop 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 -- 172.21.15.106:0/1792220207 shutdown_connections 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/1792220207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d98071290 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/1792220207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98141910 0x7f4d98141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 -- 172.21.15.106:0/1792220207 >> 172.21.15.106:0/1792220207 conn(0x7f4d980b61a0 msgr2=0x7f4d980b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 -- 172.21.15.106:0/1792220207 shutdown_connections 2024-04-16T12:57:28.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.966+0000 7f4d9c80d640 1 -- 172.21.15.106:0/1792220207 wait complete. 2024-04-16T12:57:28.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 Processor -- start 2024-04-16T12:57:28.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 -- start start 2024-04-16T12:57:28.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d980b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98072e10 0x7f4d9813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98141910 0x7f4d980b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9806d5f0 con 0x7f4d98070e00 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9806d470 con 0x7f4d98141910 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9c80d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4d981525d0 con 0x7f4d98072e10 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d980b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d980b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43100/0 (socket says 172.21.15.106:43100) 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 -- 172.21.15.106:0/331219819 learned_addr learned my addr 172.21.15.106:0/331219819 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d96d9d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98141910 0x7f4d980b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d95d9b640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98072e10 0x7f4d9813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 -- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98072e10 msgr2=0x7f4d9813ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98072e10 0x7f4d9813ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 -- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98141910 msgr2=0x7f4d980b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98141910 0x7f4d980b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d9659c640 1 -- 172.21.15.106:0/331219819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d981e0d90 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.968+0000 7f4d96d9d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98141910 0x7f4d980b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.969+0000 7f4d9659c640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d980b2440 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800c400 tx=0x7f4d8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.969+0000 7f4d86ffd640 1 -- 172.21.15.106:0/331219819 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d880052d0 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.969+0000 7f4d86ffd640 1 -- 172.21.15.106:0/331219819 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d88005490 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.969+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d980b2980 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.969+0000 7f4d86ffd640 1 -- 172.21.15.106:0/331219819 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88007260 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.969+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9813f390 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.970+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d98068a90 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.970+0000 7f4d86ffd640 1 -- 172.21.15.106:0/331219819 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d88007400 con 0x7f4d98070e00 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.971+0000 7f4d86ffd640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d7806c8f0 0x7f4d7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.971+0000 7f4d95d9b640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d7806c8f0 0x7f4d7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:28.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.971+0000 7f4d86ffd640 1 -- 172.21.15.106:0/331219819 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d8808b040 con 0x7f4d98070e00 2024-04-16T12:57:28.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.971+0000 7f4d95d9b640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d7806c8f0 0x7f4d7806edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d981e0cc0 tx=0x7f4d8c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:28.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:28.975+0000 7f4d86ffd640 1 -- 172.21.15.106:0/331219819 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d88059500 con 0x7f4d98070e00 2024-04-16T12:57:29.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.148+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4d9806cda0 con 0x7f4d98070e00 2024-04-16T12:57:29.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.149+0000 7f4d86ffd640 1 -- 172.21.15.106:0/331219819 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f4d88058e00 con 0x7f4d98070e00 2024-04-16T12:57:29.150 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:29.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d7806c8f0 msgr2=0x7f4d7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d7806c8f0 0x7f4d7806edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d981e0cc0 tx=0x7f4d8c008040 comp rx=0 tx=0).stop 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 msgr2=0x7f4d980b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d980b2440 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800c400 tx=0x7f4d8800c8c0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 shutdown_connections 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d7806c8f0 0x7f4d7806edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98141910 0x7f4d980b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d98072e10 0x7f4d9813ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 --2- 172.21.15.106:0/331219819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d98070e00 0x7f4d980b2440 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 >> 172.21.15.106:0/331219819 conn(0x7f4d980b61a0 msgr2=0x7f4d980b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 shutdown_connections 2024-04-16T12:57:29.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.151+0000 7f4d9c80d640 1 -- 172.21.15.106:0/331219819 wait complete. 2024-04-16T12:57:29.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.267+0000 7f048c821640 1 Processor -- start 2024-04-16T12:57:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.267+0000 7f048c821640 1 -- start start 2024-04-16T12:57:29.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.267+0000 7f048c821640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f048806e5d0 0x7f048806d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.267+0000 7f048c821640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f04880b5220 0x7f04880b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.267+0000 7f048c821640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048806e9b0 con 0x7f048814b4b0 2024-04-16T12:57:29.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.267+0000 7f048c821640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f0488072400 con 0x7f04880b5220 2024-04-16T12:57:29.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.267+0000 7f048c821640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f04880b7440 con 0x7f048806e5d0 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f0485d9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f04880b5220 0x7f04880b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f0486d9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f048814b4b0 0x7f048814b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59432/0 (socket says 172.21.15.106:59432) 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f0486d9d640 1 -- 172.21.15.106:0/3859907488 learned_addr learned my addr 172.21.15.106:0/3859907488 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f048659c640 1 --2- 172.21.15.106:0/3859907488 >> v2:172.21.15.171:3300/0 conn(0x7f048806e5d0 0x7f048806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f0485d9b640 1 -- 172.21.15.106:0/3859907488 >> v2:172.21.15.171:3300/0 conn(0x7f048806e5d0 msgr2=0x7f048806d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f0485d9b640 1 --2- 172.21.15.106:0/3859907488 >> v2:172.21.15.171:3300/0 conn(0x7f048806e5d0 0x7f048806d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f0485d9b640 1 -- 172.21.15.106:0/3859907488 >> v1:172.21.15.106:6789/0 conn(0x7f048814b4b0 legacy=0x7f048814b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f0485d9b640 1 -- 172.21.15.106:0/3859907488 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048806db60 con 0x7f04880b5220 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.268+0000 7f048559a640 1 -- 172.21.15.106:0/3859907488 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238212130 0 0) 0x7f048806e9b0 con 0x7f048814b4b0 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f0485d9b640 1 --2- 172.21.15.106:0/3859907488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880b5680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f048806c2c0 tx=0x7f047c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0ef4d60d9ef627 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048559a640 1 -- 172.21.15.106:0/3859907488 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c039070 con 0x7f04880b5220 2024-04-16T12:57:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048559a640 1 -- 172.21.15.106:0/3859907488 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c02cbf0 con 0x7f04880b5220 2024-04-16T12:57:29.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048559a640 1 -- 172.21.15.106:0/3859907488 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c034440 con 0x7f04880b5220 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 -- 172.21.15.106:0/3859907488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 msgr2=0x7f04880b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 --2- 172.21.15.106:0/3859907488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880b5680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f048806c2c0 tx=0x7f047c02be40 comp rx=0 tx=0).stop 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 -- 172.21.15.106:0/3859907488 shutdown_connections 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 --2- 172.21.15.106:0/3859907488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880b5680 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 --2- 172.21.15.106:0/3859907488 >> v2:172.21.15.171:3300/0 conn(0x7f048806e5d0 0x7f048806d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 -- 172.21.15.106:0/3859907488 >> 172.21.15.106:0/3859907488 conn(0x7f04880bb4e0 msgr2=0x7f04880bb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 -- 172.21.15.106:0/3859907488 shutdown_connections 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.269+0000 7f048c821640 1 -- 172.21.15.106:0/3859907488 wait complete. 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 Processor -- start 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 -- start start 2024-04-16T12:57:29.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048806e5d0 0x7f04880af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048814b4b0 0x7f04880ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f04880b2570 con 0x7f04880b5220 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f048806d1c0 con 0x7f048806e5d0 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048c821640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f048814c030 con 0x7f048814b4b0 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f0485d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f0485d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43118/0 (socket says 172.21.15.106:43118) 2024-04-16T12:57:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f0485d9b640 1 -- 172.21.15.106:0/2550923052 learned_addr learned my addr 172.21.15.106:0/2550923052 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f0485d9b640 1 -- 172.21.15.106:0/2550923052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048814b4b0 msgr2=0x7f04880ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f0485d9b640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048814b4b0 0x7f04880ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f048659c640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048806e5d0 0x7f04880af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f0485d9b640 1 -- 172.21.15.106:0/2550923052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048806e5d0 msgr2=0x7f04880af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.271+0000 7f0485d9b640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048806e5d0 0x7f04880af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.272+0000 7f0485d9b640 1 -- 172.21.15.106:0/2550923052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04880b0600 con 0x7f04880b5220 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.272+0000 7f0485d9b640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880adec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f047c037040 tx=0x7f047c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.272+0000 7f0476ffd640 1 -- 172.21.15.106:0/2550923052 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c039050 con 0x7f04880b5220 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.272+0000 7f0476ffd640 1 -- 172.21.15.106:0/2550923052 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c045070 con 0x7f04880b5220 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.272+0000 7f0476ffd640 1 -- 172.21.15.106:0/2550923052 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c03e850 con 0x7f04880b5220 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.272+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04880b1420 con 0x7f04880b5220 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.272+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04881d4880 con 0x7f04880b5220 2024-04-16T12:57:29.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.273+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0488068a90 con 0x7f04880b5220 2024-04-16T12:57:29.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.273+0000 7f0476ffd640 1 -- 172.21.15.106:0/2550923052 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f047c03e9f0 con 0x7f04880b5220 2024-04-16T12:57:29.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.274+0000 7f0476ffd640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f046806c8f0 0x7f046806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.274+0000 7f048659c640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f046806c8f0 0x7f046806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.274+0000 7f0476ffd640 1 -- 172.21.15.106:0/2550923052 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f047c0ae950 con 0x7f04880b5220 2024-04-16T12:57:29.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.274+0000 7f048659c640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f046806c8f0 0x7f046806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0478009a10 tx=0x7f0478008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.278+0000 7f0476ffd640 1 -- 172.21.15.106:0/2550923052 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f047c07cf30 con 0x7f04880b5220 2024-04-16T12:57:29.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.455+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f04880babb0 con 0x7f04880b5220 2024-04-16T12:57:29.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.456+0000 7f0476ffd640 1 -- 172.21.15.106:0/2550923052 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f047c07c830 con 0x7f04880b5220 2024-04-16T12:57:29.457 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:29.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.457+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f046806c8f0 msgr2=0x7f046806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.457+0000 7f048c821640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f046806c8f0 0x7f046806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0478009a10 tx=0x7f0478008040 comp rx=0 tx=0).stop 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.457+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 msgr2=0x7f04880adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.457+0000 7f048c821640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880adec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f047c037040 tx=0x7f047c004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.457+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 shutdown_connections 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.457+0000 7f048c821640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f046806c8f0 0x7f046806edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.458+0000 7f048c821640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048814b4b0 0x7f04880ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.458+0000 7f048c821640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04880b5220 0x7f04880adec0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.458+0000 7f048c821640 1 --2- 172.21.15.106:0/2550923052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048806e5d0 0x7f04880af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.458+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 >> 172.21.15.106:0/2550923052 conn(0x7f04880bb4e0 msgr2=0x7f04880b8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.458+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 shutdown_connections 2024-04-16T12:57:29.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.458+0000 7f048c821640 1 -- 172.21.15.106:0/2550923052 wait complete. 2024-04-16T12:57:29.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:29.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe2163f4640 1 Processor -- start 2024-04-16T12:57:29.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe2163f4640 1 -- start start 2024-04-16T12:57:29.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe2163f4640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe210148c30 0x7fe21009eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe2163f4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21014c030 con 0x7fe21014b6d0 2024-04-16T12:57:29.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe2163f4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21014c310 con 0x7fe21009cb60 2024-04-16T12:57:29.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe2163f4640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe210148090 con 0x7fe210148c30 2024-04-16T12:57:29.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe20ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe21014b6d0 0x7fe210148520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59434/0 (socket says 172.21.15.106:59434) 2024-04-16T12:57:29.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.575+0000 7fe20ffff640 1 -- 172.21.15.106:0/204850886 learned_addr learned my addr 172.21.15.106:0/204850886 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:29.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828522928 0 0) 0x7fe21014c030 con 0x7fe21014b6d0 2024-04-16T12:57:29.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20f7fe640 1 --2- 172.21.15.106:0/204850886 >> v2:172.21.15.171:3300/0 conn(0x7fe210148c30 0x7fe21009eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1fc003520 con 0x7fe21014b6d0 2024-04-16T12:57:29.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 812640036 0 0) 0x7fe1fc003520 con 0x7fe21014b6d0 2024-04-16T12:57:29.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 >> v2:172.21.15.171:3300/0 conn(0x7fe210148c30 msgr2=0x7fe21009eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:29.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 --2- 172.21.15.106:0/204850886 >> v2:172.21.15.171:3300/0 conn(0x7fe210148c30 0x7fe21009eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 >> v1:172.21.15.171:6789/0 conn(0x7fe21009cb60 legacy=0x7fe210152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21009b310 con 0x7fe21014b6d0 2024-04-16T12:57:29.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fe200001690 con 0x7fe21014b6d0 2024-04-16T12:57:29.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 >> v1:172.21.15.106:6789/0 conn(0x7fe21014b6d0 legacy=0x7fe210148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0039b0 0x7fe1fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc004800 0x7fe1fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc0052e0 0x7fe1fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe210148090 con 0x7fe1fc004800 2024-04-16T12:57:29.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc00c1b0 con 0x7fe1fc0052e0 2024-04-16T12:57:29.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1fc00c3b0 con 0x7fe1fc0039b0 2024-04-16T12:57:29.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20f7fe640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc004800 0x7fe1fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20ffff640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0039b0 0x7fe1fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe214991640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc0052e0 0x7fe1fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20f7fe640 1 -- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0039b0 msgr2=0x7fe1fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:29.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20f7fe640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0039b0 0x7fe1fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20f7fe640 1 -- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc0052e0 msgr2=0x7fe1fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:29.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20f7fe640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc0052e0 0x7fe1fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe214991640 1 -- 172.21.15.106:0/204850886 reap_dead start 2024-04-16T12:57:29.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.576+0000 7fe20f7fe640 1 -- 172.21.15.106:0/204850886 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc003520 con 0x7fe1fc004800 2024-04-16T12:57:29.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.577+0000 7fe20f7fe640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc004800 0x7fe1fc004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009a90 tx=0x7fe1fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ededbb396dffc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.577+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8039070 con 0x7fe1fc004800 2024-04-16T12:57:29.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.577+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f802c680 con 0x7fe1fc004800 2024-04-16T12:57:29.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.577+0000 7fe20effd640 1 -- 172.21.15.106:0/204850886 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8009690 con 0x7fe1fc004800 2024-04-16T12:57:29.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.577+0000 7fe2163f4640 1 -- 172.21.15.106:0/204850886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc004800 msgr2=0x7fe1fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.577+0000 7fe2163f4640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc004800 0x7fe1fc004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009a90 tx=0x7fe1fc005830 comp rx=0 tx=0).stop 2024-04-16T12:57:29.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.578+0000 7fe2163f4640 1 -- 172.21.15.106:0/204850886 shutdown_connections 2024-04-16T12:57:29.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.578+0000 7fe2163f4640 1 --2- 172.21.15.106:0/204850886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc004800 0x7fe1fc004c80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.578+0000 7fe2163f4640 1 -- 172.21.15.106:0/204850886 >> 172.21.15.106:0/204850886 conn(0x7fe2100ba080 msgr2=0x7fe2100ba490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:29.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.578+0000 7fe2163f4640 1 -- 172.21.15.106:0/204850886 shutdown_connections 2024-04-16T12:57:29.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.578+0000 7fe2163f4640 1 -- 172.21.15.106:0/204850886 wait complete. 2024-04-16T12:57:29.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 Processor -- start 2024-04-16T12:57:29.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 -- start start 2024-04-16T12:57:29.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc004800 0x7fe2100b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2100a2610 0x7fe2100a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2101e1860 0x7fe2101e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe21009d470 con 0x7fe2101e1860 2024-04-16T12:57:29.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe21014bcc0 con 0x7fe2100a2610 2024-04-16T12:57:29.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe2163f4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe210148520 con 0x7fe1fc004800 2024-04-16T12:57:29.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe214991640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2101e1860 0x7fe2101e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe214991640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2101e1860 0x7fe2101e1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43144/0 (socket says 172.21.15.106:43144) 2024-04-16T12:57:29.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.579+0000 7fe214991640 1 -- 172.21.15.106:0/347709398 learned_addr learned my addr 172.21.15.106:0/347709398 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:29.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe20ffff640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc004800 0x7fe2100b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe20f7fe640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2100a2610 0x7fe2100a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe214991640 1 -- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc004800 msgr2=0x7fe2100b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe214991640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc004800 0x7fe2100b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe214991640 1 -- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2100a2610 msgr2=0x7fe2100a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe214991640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2100a2610 0x7fe2100a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe214991640 1 -- 172.21.15.106:0/347709398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2100b2830 con 0x7fe2101e1860 2024-04-16T12:57:29.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe20ffff640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc004800 0x7fe2100b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:29.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe20f7fe640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2100a2610 0x7fe2100a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:29.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe214991640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2101e1860 0x7fe2101e1cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe208007fd0 tx=0x7fe20800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe20cff9640 1 -- 172.21.15.106:0/347709398 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208019070 con 0x7fe2101e1860 2024-04-16T12:57:29.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe20cff9640 1 -- 172.21.15.106:0/347709398 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe208006b50 con 0x7fe2101e1860 2024-04-16T12:57:29.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe20cff9640 1 -- 172.21.15.106:0/347709398 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208003970 con 0x7fe2101e1860 2024-04-16T12:57:29.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2100b1a90 con 0x7fe2101e1860 2024-04-16T12:57:29.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.580+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2100a13b0 con 0x7fe2101e1860 2024-04-16T12:57:29.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.581+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe210068a90 con 0x7fe2101e1860 2024-04-16T12:57:29.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.581+0000 7fe20cff9640 1 -- 172.21.15.106:0/347709398 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe20801c070 con 0x7fe2101e1860 2024-04-16T12:57:29.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.582+0000 7fe20cff9640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1f006c8f0 0x7fe1f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.582+0000 7fe20ffff640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1f006c8f0 0x7fe1f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.582+0000 7fe20cff9640 1 -- 172.21.15.106:0/347709398 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe20808b090 con 0x7fe2101e1860 2024-04-16T12:57:29.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.582+0000 7fe20ffff640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1f006c8f0 0x7fe1f006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe21009cac0 tx=0x7fe200009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.586+0000 7fe20cff9640 1 -- 172.21.15.106:0/347709398 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe208059550 con 0x7fe2101e1860 2024-04-16T12:57:29.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.759+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2100b7930 con 0x7fe2101e1860 2024-04-16T12:57:29.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.759+0000 7fe20cff9640 1 -- 172.21.15.106:0/347709398 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe208058e50 con 0x7fe2101e1860 2024-04-16T12:57:29.761 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:29.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1f006c8f0 msgr2=0x7fe1f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1f006c8f0 0x7fe1f006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe21009cac0 tx=0x7fe200009040 comp rx=0 tx=0).stop 2024-04-16T12:57:29.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2101e1860 msgr2=0x7fe2101e1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2101e1860 0x7fe2101e1cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe208007fd0 tx=0x7fe20800eb90 comp rx=0 tx=0).stop 2024-04-16T12:57:29.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 shutdown_connections 2024-04-16T12:57:29.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1f006c8f0 0x7fe1f006edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2101e1860 0x7fe2101e1cc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2100a2610 0x7fe2100a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 --2- 172.21.15.106:0/347709398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc004800 0x7fe2100b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 >> 172.21.15.106:0/347709398 conn(0x7fe2100ba080 msgr2=0x7fe210146500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:29.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 shutdown_connections 2024-04-16T12:57:29.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.761+0000 7fe2163f4640 1 -- 172.21.15.106:0/347709398 wait complete. 2024-04-16T12:57:29.774 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:29.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.875+0000 7f994cdba640 1 Processor -- start 2024-04-16T12:57:29.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.875+0000 7f994cdba640 1 -- start start 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.875+0000 7f994cdba640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9948144db0 0x7f99480b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.875+0000 7f994cdba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99480b3fc0 con 0x7f99480b4a50 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.875+0000 7f994cdba640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99480b9720 con 0x7f99480afee0 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.875+0000 7f994cdba640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f99480b9a00 con 0x7f9948144db0 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f99480b4a50 0x7f994809d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59438/0 (socket says 172.21.15.106:59438) 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 -- 172.21.15.106:0/1789370943 learned_addr learned my addr 172.21.15.106:0/1789370943 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581268812 0 0) 0x7f99480b3fc0 con 0x7f99480b4a50 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9934003520 con 0x7f99480b4a50 2024-04-16T12:57:29.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f9946d9d640 1 --2- 172.21.15.106:0/1789370943 >> v2:172.21.15.171:3300/0 conn(0x7f9948144db0 0x7f99480b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 652199178 0 0) 0x7f9934003520 con 0x7f99480b4a50 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 >> v2:172.21.15.171:3300/0 conn(0x7f9948144db0 msgr2=0x7f99480b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 --2- 172.21.15.106:0/1789370943 >> v2:172.21.15.171:3300/0 conn(0x7f9948144db0 0x7f99480b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 >> v1:172.21.15.171:6789/0 conn(0x7f99480afee0 legacy=0x7f99481446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99480b4e30 con 0x7f99480b4a50 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f9940001670 con 0x7f99480b4a50 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 >> v1:172.21.15.106:6789/0 conn(0x7f99480b4a50 legacy=0x7f994809d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99340039b0 0x7f9934003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9934004800 0x7f9934004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99340052e0 0x7f9934005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f99480b9a00 con 0x7f99340039b0 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9934006270 con 0x7f99340052e0 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9934006470 con 0x7f9934004800 2024-04-16T12:57:29.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99340039b0 0x7f9934003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f9946d9d640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99340052e0 0x7f9934005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f9945d9b640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9934004800 0x7f9934004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 -- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9934004800 msgr2=0x7f9934004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9934004800 0x7f9934004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 -- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99340052e0 msgr2=0x7f9934005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99340052e0 0x7f9934005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f994659c640 1 -- 172.21.15.106:0/1789370943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9934003520 con 0x7f99340039b0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.876+0000 7f9946d9d640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99340052e0 0x7f9934005990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.877+0000 7f9946d9d640 1 -- 172.21.15.106:0/1789370943 reap_dead start 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.877+0000 7f994659c640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99340039b0 0x7f9934003dd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f994000c210 tx=0x7f9934005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8053b3776d0a1492 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.877+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940007d30 con 0x7f99340039b0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.877+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940030070 con 0x7f99340039b0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.877+0000 7f994559a640 1 -- 172.21.15.106:0/1789370943 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940005d70 con 0x7f99340039b0 2024-04-16T12:57:29.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.878+0000 7f994cdba640 1 -- 172.21.15.106:0/1789370943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99340039b0 msgr2=0x7f9934003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.878+0000 7f994cdba640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99340039b0 0x7f9934003dd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f994000c210 tx=0x7f9934005830 comp rx=0 tx=0).stop 2024-04-16T12:57:29.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.878+0000 7f994cdba640 1 -- 172.21.15.106:0/1789370943 shutdown_connections 2024-04-16T12:57:29.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.878+0000 7f994cdba640 1 --2- 172.21.15.106:0/1789370943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99340039b0 0x7f9934003dd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.878+0000 7f994cdba640 1 -- 172.21.15.106:0/1789370943 >> 172.21.15.106:0/1789370943 conn(0x7f994809cc10 msgr2=0x7f994806d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:29.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.878+0000 7f994cdba640 1 -- 172.21.15.106:0/1789370943 shutdown_connections 2024-04-16T12:57:29.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.878+0000 7f994cdba640 1 -- 172.21.15.106:0/1789370943 wait complete. 2024-04-16T12:57:29.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.879+0000 7f994cdba640 1 Processor -- start 2024-04-16T12:57:29.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.879+0000 7f994cdba640 1 -- start start 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99340039b0 0x7f9948071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9948072c70 0x7f9948147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9948070860 0x7f99481dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f99480b04c0 con 0x7f9948070860 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f99480b0340 con 0x7f9948072c70 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f99480b0640 con 0x7f99340039b0 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9948070860 0x7f99481dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9948070860 0x7f99481dcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43162/0 (socket says 172.21.15.106:43162) 2024-04-16T12:57:29.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 -- 172.21.15.106:0/860571426 learned_addr learned my addr 172.21.15.106:0/860571426 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994659c640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99340039b0 0x7f9948071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9945d9b640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9948072c70 0x7f9948147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 -- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99340039b0 msgr2=0x7f9948071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99340039b0 0x7f9948071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 -- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9948072c70 msgr2=0x7f9948147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9948072c70 0x7f9948147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 -- 172.21.15.106:0/860571426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99481da960 con 0x7f9948070860 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f9946d9d640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9948070860 0x7f99481dcfb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f994809c590 tx=0x7f9938010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f993effd640 1 -- 172.21.15.106:0/860571426 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993801a030 con 0x7f9948070860 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f993effd640 1 -- 172.21.15.106:0/860571426 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938010da0 con 0x7f9948070860 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f993effd640 1 -- 172.21.15.106:0/860571426 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938003bd0 con 0x7f9948070860 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99480731a0 con 0x7f9948070860 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.880+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99481da160 con 0x7f9948070860 2024-04-16T12:57:29.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.881+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9948068a90 con 0x7f9948070860 2024-04-16T12:57:29.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.882+0000 7f993effd640 1 -- 172.21.15.106:0/860571426 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f993801d070 con 0x7f9948070860 2024-04-16T12:57:29.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.882+0000 7f993effd640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f992806c890 0x7f992806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:29.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.882+0000 7f994659c640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f992806c890 0x7f992806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:29.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.882+0000 7f993effd640 1 -- 172.21.15.106:0/860571426 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f993808c030 con 0x7f9948070860 2024-04-16T12:57:29.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.883+0000 7f994659c640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f992806c890 0x7f992806ed50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9940034000 tx=0x7f9940009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:29.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:29.887+0000 7f993effd640 1 -- 172.21.15.106:0/860571426 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f993805a4f0 con 0x7f9948070860 2024-04-16T12:57:30.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.100+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99480b7a40 con 0x7f9948070860 2024-04-16T12:57:30.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.100+0000 7f993effd640 1 -- 172.21.15.106:0/860571426 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f9938059df0 con 0x7f9948070860 2024-04-16T12:57:30.102 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:30.103 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:30.103 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:30.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f992806c890 msgr2=0x7f992806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f992806c890 0x7f992806ed50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9940034000 tx=0x7f9940009030 comp rx=0 tx=0).stop 2024-04-16T12:57:30.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9948070860 msgr2=0x7f99481dcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9948070860 0x7f99481dcfb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f994809c590 tx=0x7f9938010590 comp rx=0 tx=0).stop 2024-04-16T12:57:30.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 shutdown_connections 2024-04-16T12:57:30.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f992806c890 0x7f992806ed50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9948070860 0x7f99481dcfb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9948072c70 0x7f9948147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 --2- 172.21.15.106:0/860571426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99340039b0 0x7f9948071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 >> 172.21.15.106:0/860571426 conn(0x7f994809cc10 msgr2=0x7f9948141720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:30.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.102+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 shutdown_connections 2024-04-16T12:57:30.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.103+0000 7f994cdba640 1 -- 172.21.15.106:0/860571426 wait complete. 2024-04-16T12:57:30.115 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:30.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.216+0000 7f4dbed67640 1 Processor -- start 2024-04-16T12:57:30.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.216+0000 7f4dbed67640 1 -- start start 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.216+0000 7f4dbed67640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 0x7f4db814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.216+0000 7f4dbed67640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4db80bc040 0x7f4db8152830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.216+0000 7f4dbed67640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4db8073ec0 con 0x7f4db80bbc60 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.216+0000 7f4dbed67640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4db80b7580 con 0x7f4db80bc040 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.216+0000 7f4dbed67640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4db8073a10 con 0x7f4db806e650 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4db80bbc60 0x7f4db80b60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59446/0 (socket says 172.21.15.106:59446) 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 -- 172.21.15.106:0/484908644 learned_addr learned my addr 172.21.15.106:0/484908644 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbd304640 1 --2- 172.21.15.106:0/484908644 >> v2:172.21.15.171:3300/0 conn(0x7f4db80bc040 0x7f4db8152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db7fff640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 0x7f4db814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4164349064 0 0) 0x7f4db8073ec0 con 0x7f4db80bbc60 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4da8003520 con 0x7f4db80bbc60 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1175355973 0 0) 0x7f4da8003520 con 0x7f4db80bbc60 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 msgr2=0x7f4db814bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 0x7f4db814bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 >> v2:172.21.15.171:3300/0 conn(0x7f4db80bc040 msgr2=0x7f4db8152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 --2- 172.21.15.106:0/484908644 >> v2:172.21.15.171:3300/0 conn(0x7f4db80bc040 0x7f4db8152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db8072bd0 con 0x7f4db80bbc60 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f4dac001670 con 0x7f4db80bbc60 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 >> v1:172.21.15.106:6789/0 conn(0x7f4db80bbc60 legacy=0x7f4db80b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da80039b0 0x7f4da8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4da8004800 0x7f4da8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 0x7f4da80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4db80b7580 con 0x7f4da80039b0 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4db8073a10 con 0x7f4da8004800 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4da800b9c0 con 0x7f4db806e650 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da80039b0 0x7f4da8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4db7fff640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4da8004800 0x7f4da8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbd304640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 0x7f4da80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 -- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 msgr2=0x7f4da80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4db806e650 0x7f4da80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 -- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4da8004800 msgr2=0x7f4da8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4da8004800 0x7f4da8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.217+0000 7f4dbcb03640 1 -- 172.21.15.106:0/484908644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da8003520 con 0x7f4da80039b0 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.218+0000 7f4dbcb03640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da80039b0 0x7f4da8003dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c240 tx=0x7f4da8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef1cc0c6d52322a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.218+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac007d50 con 0x7f4da80039b0 2024-04-16T12:57:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.218+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dac030070 con 0x7f4da80039b0 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.218+0000 7f4db77fe640 1 -- 172.21.15.106:0/484908644 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac02cd80 con 0x7f4da80039b0 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.219+0000 7f4dbed67640 1 -- 172.21.15.106:0/484908644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da80039b0 msgr2=0x7f4da8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.219+0000 7f4dbed67640 1 --2- 172.21.15.106:0/484908644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da80039b0 0x7f4da8003dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c240 tx=0x7f4da8005830 comp rx=0 tx=0).stop 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.219+0000 7f4dbd304640 1 -- 172.21.15.106:0/484908644 reap_dead start 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.219+0000 7f4dbed67640 1 -- 172.21.15.106:0/484908644 shutdown_connections 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.219+0000 7f4dbed67640 1 -- 172.21.15.106:0/484908644 >> 172.21.15.106:0/484908644 conn(0x7f4db8067e20 msgr2=0x7f4db80bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.219+0000 7f4dbed67640 1 -- 172.21.15.106:0/484908644 shutdown_connections 2024-04-16T12:57:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.219+0000 7f4dbed67640 1 -- 172.21.15.106:0/484908644 wait complete. 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.220+0000 7f4dbed67640 1 Processor -- start 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.220+0000 7f4dbed67640 1 -- start start 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbed67640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4da80039b0 0x7f4db813f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbed67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4db81d3140 0x7f4db8147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbed67640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4db8147660 0x7f4db8138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbed67640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4db814b680 con 0x7f4db8147660 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbed67640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4db814b500 con 0x7f4db81d3140 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbed67640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4db814bbf0 con 0x7f4da80039b0 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4db8147660 0x7f4db8138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4db8147660 0x7f4db8138870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43186/0 (socket says 172.21.15.106:43186) 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 -- 172.21.15.106:0/1446472018 learned_addr learned my addr 172.21.15.106:0/1446472018 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbcb03640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4da80039b0 0x7f4db813f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4db7fff640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4db81d3140 0x7f4db8147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 -- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4da80039b0 msgr2=0x7f4db813f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4da80039b0 0x7f4db813f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 -- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4db81d3140 msgr2=0x7f4db8147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4db81d3140 0x7f4db8147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 -- 172.21.15.106:0/1446472018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db8145ea0 con 0x7f4db8147660 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4db7fff640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4db81d3140 0x7f4db8147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbd304640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4db8147660 0x7f4db8138870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4db80b7a10 tx=0x7f4db00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4db57fa640 1 -- 172.21.15.106:0/1446472018 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0011e10 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4db57fa640 1 -- 172.21.15.106:0/1446472018 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db001b070 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db8146180 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.221+0000 7f4db57fa640 1 -- 172.21.15.106:0/1446472018 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0003990 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.222+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db81d23d0 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.223+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db8068a90 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.223+0000 7f4db57fa640 1 -- 172.21.15.106:0/1446472018 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4db0005d10 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.223+0000 7f4db57fa640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.223+0000 7f4db57fa640 1 -- 172.21.15.106:0/1446472018 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4db008c090 con 0x7f4db8147660 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.223+0000 7f4dbcb03640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.224+0000 7f4dbcb03640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4dac034000 tx=0x7f4dac007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.228+0000 7f4db57fa640 1 -- 172.21.15.106:0/1446472018 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4db0025020 con 0x7f4db8147660 2024-04-16T12:57:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.404+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4db814ae30 con 0x7f4db8147660 2024-04-16T12:57:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.405+0000 7f4db57fa640 1 -- 172.21.15.106:0/1446472018 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f4db005a550 con 0x7f4db8147660 2024-04-16T12:57:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:30.407 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d9c06c8f0 msgr2=0x7f4d9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4dac034000 tx=0x7f4dac007000 comp rx=0 tx=0).stop 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4db8147660 msgr2=0x7f4db8138870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4db8147660 0x7f4db8138870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4db80b7a10 tx=0x7f4db00115a0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 shutdown_connections 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4db8147660 0x7f4db8138870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4db81d3140 0x7f4db8147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 --2- 172.21.15.106:0/1446472018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4da80039b0 0x7f4db813f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 >> 172.21.15.106:0/1446472018 conn(0x7f4db8067e20 msgr2=0x7f4db814a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:30.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 shutdown_connections 2024-04-16T12:57:30.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.407+0000 7f4dbed67640 1 -- 172.21.15.106:0/1446472018 wait complete. 2024-04-16T12:57:30.420 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:30.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a59da8640 1 Processor -- start 2024-04-16T12:57:30.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a59da8640 1 -- start start 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a59da8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9a540b51b0 0x7f9a54148680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a59da8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a54152800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a59da8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5406db60 con 0x7f9a540bbe20 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a59da8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f9a540b7df0 con 0x7f9a540b51b0 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a59da8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5406cc60 con 0x7f9a54148bc0 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a52ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9a540b51b0 0x7f9a54148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a537fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9a540bbe20 0x7f9a5406e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59454/0 (socket says 172.21.15.106:59454) 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a52ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9a540b51b0 0x7f9a54148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43198/0 (socket says 172.21.15.106:43198) 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a537fe640 1 -- 172.21.15.106:0/2998683600 learned_addr learned my addr 172.21.15.106:0/2998683600 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.521+0000 7f9a53fff640 1 --2- 172.21.15.106:0/2998683600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a54152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a52ffd640 1 -- 172.21.15.106:0/2998683600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 msgr2=0x7f9a54152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a52ffd640 1 --2- 172.21.15.106:0/2998683600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a54152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a52ffd640 1 -- 172.21.15.106:0/2998683600 >> v1:172.21.15.106:6789/0 conn(0x7f9a540bbe20 legacy=0x7f9a5406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a52ffd640 1 -- 172.21.15.106:0/2998683600 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a540bc200 con 0x7f9a540b51b0 2024-04-16T12:57:30.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a527fc640 1 -- 172.21.15.106:0/2998683600 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773452901 0 0) 0x7f9a44001490 con 0x7f9a540bbe20 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a52ffd640 1 --2- 172.21.15.106:0/2998683600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540b51b0 0x7f9a54148680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097a0 tx=0x7f9a3c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477cc3ba823a5356 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a527fc640 1 -- 172.21.15.106:0/2998683600 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c038070 con 0x7f9a540b51b0 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a527fc640 1 -- 172.21.15.106:0/2998683600 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3c031700 con 0x7f9a540b51b0 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.522+0000 7f9a527fc640 1 -- 172.21.15.106:0/2998683600 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c031ad0 con 0x7f9a540b51b0 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 -- 172.21.15.106:0/2998683600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540b51b0 msgr2=0x7f9a54148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 --2- 172.21.15.106:0/2998683600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540b51b0 0x7f9a54148680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097a0 tx=0x7f9a3c02b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 -- 172.21.15.106:0/2998683600 shutdown_connections 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 --2- 172.21.15.106:0/2998683600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a54152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 --2- 172.21.15.106:0/2998683600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540b51b0 0x7f9a54148680 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 -- 172.21.15.106:0/2998683600 >> 172.21.15.106:0/2998683600 conn(0x7f9a54067e20 msgr2=0x7f9a540bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 -- 172.21.15.106:0/2998683600 shutdown_connections 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.523+0000 7f9a59da8640 1 -- 172.21.15.106:0/2998683600 wait complete. 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.524+0000 7f9a59da8640 1 Processor -- start 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.524+0000 7f9a59da8640 1 -- start start 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a59da8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a540b51b0 0x7f9a541cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a59da8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540bbe20 0x7f9a540ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a59da8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a541e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a59da8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9a540b62b0 con 0x7f9a540bbe20 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a59da8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5406de40 con 0x7f9a540b51b0 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a59da8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9a540b2570 con 0x7f9a54148bc0 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540bbe20 0x7f9a540ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540bbe20 0x7f9a540ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43212/0 (socket says 172.21.15.106:43212) 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 -- 172.21.15.106:0/3113260493 learned_addr learned my addr 172.21.15.106:0/3113260493 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a53fff640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a541e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a537fe640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a540b51b0 0x7f9a541cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 -- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 msgr2=0x7f9a541e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a541e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 -- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a540b51b0 msgr2=0x7f9a541cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a540b51b0 0x7f9a541cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 -- 172.21.15.106:0/3113260493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a541cfa20 con 0x7f9a540bbe20 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a52ffd640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540bbe20 0x7f9a540ae130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097a0 tx=0x7f9a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a4bfff640 1 -- 172.21.15.106:0/3113260493 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c038040 con 0x7f9a540bbe20 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a4bfff640 1 -- 172.21.15.106:0/3113260493 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3c004270 con 0x7f9a540bbe20 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.525+0000 7f9a4bfff640 1 -- 172.21.15.106:0/3113260493 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0337a0 con 0x7f9a540bbe20 2024-04-16T12:57:30.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.526+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a540b1160 con 0x7f9a540bbe20 2024-04-16T12:57:30.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.526+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a541cdf50 con 0x7f9a540bbe20 2024-04-16T12:57:30.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.526+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a540691a0 con 0x7f9a540bbe20 2024-04-16T12:57:30.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.527+0000 7f9a4bfff640 1 -- 172.21.15.106:0/3113260493 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a3c0315c0 con 0x7f9a540bbe20 2024-04-16T12:57:30.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.527+0000 7f9a4bfff640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9a3406c8f0 0x7f9a3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:30.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.527+0000 7f9a4bfff640 1 -- 172.21.15.106:0/3113260493 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9a3c0aded0 con 0x7f9a540bbe20 2024-04-16T12:57:30.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.527+0000 7f9a537fe640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9a3406c8f0 0x7f9a3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:30.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.528+0000 7f9a537fe640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9a3406c8f0 0x7f9a3406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a440012e0 tx=0x7f9a44007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:30.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.532+0000 7f9a4bfff640 1 -- 172.21.15.106:0/3113260493 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a3c030070 con 0x7f9a540bbe20 2024-04-16T12:57:30.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.743+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a540b4660 con 0x7f9a540bbe20 2024-04-16T12:57:30.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.744+0000 7f9a4bfff640 1 -- 172.21.15.106:0/3113260493 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f9a3c07c300 con 0x7f9a540bbe20 2024-04-16T12:57:30.746 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:30.746 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9a3406c8f0 msgr2=0x7f9a3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9a3406c8f0 0x7f9a3406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a440012e0 tx=0x7f9a44007cf0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540bbe20 msgr2=0x7f9a540ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540bbe20 0x7f9a540ae130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097a0 tx=0x7f9a3c0046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 shutdown_connections 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f9a3406c8f0 0x7f9a3406edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a54148bc0 0x7f9a541e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a540bbe20 0x7f9a540ae130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 --2- 172.21.15.106:0/3113260493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a540b51b0 0x7f9a541cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 >> 172.21.15.106:0/3113260493 conn(0x7f9a54067e20 msgr2=0x7f9a54072c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 shutdown_connections 2024-04-16T12:57:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:30.746+0000 7f9a59da8640 1 -- 172.21.15.106:0/3113260493 wait complete. 2024-04-16T12:57:30.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T12:57:18.241720+0000', 'modified': '2024-04-16T12:57:20.236166+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6835/1351002879', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 1351002879}, {'type': 'v1', 'addr': '172.21.15.106:6835', 'nonce': 1351002879}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4275, 'qdb_cluster': [4275]} 2024-04-16T12:57:30.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T12:57:30.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-16T12:57:31.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.063+0000 7f5532a2c640 1 Processor -- start 2024-04-16T12:57:31.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.063+0000 7f5532a2c640 1 -- start start 2024-04-16T12:57:31.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5532a2c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f552c151690 0x7f552c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5532a2c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552c0b6cd0 con 0x7f552c0b68f0 2024-04-16T12:57:31.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5532a2c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552c0b3c70 con 0x7f552c141bf0 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5532a2c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f552c0b3500 con 0x7f552c151690 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5530fc9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f552c151690 0x7f552c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5530fc9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f552c151690 0x7f552c153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43216/0 (socket says 172.21.15.106:43216) 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5530fc9640 1 -- 172.21.15.106:0/3500217874 learned_addr learned my addr 172.21.15.106:0/3500217874 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5530fc9640 1 -- 172.21.15.106:0/3500217874 >> v1:172.21.15.171:6789/0 conn(0x7f552c141bf0 legacy=0x7f552c142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5530fc9640 1 -- 172.21.15.106:0/3500217874 >> v1:172.21.15.106:6789/0 conn(0x7f552c0b68f0 legacy=0x7f552c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f5530fc9640 1 -- 172.21.15.106:0/3500217874 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c0b1d40 con 0x7f552c151690 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.064+0000 7f552affd640 1 -- 172.21.15.106:0/3500217874 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690926266 0 0) 0x7f552c0b6cd0 con 0x7f552c0b68f0 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.065+0000 7f5530fc9640 1 --2- 172.21.15.106:0/3500217874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c151690 0x7f552c153a80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5524009e50 tx=0x7f552402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ff1d0085976800 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.065+0000 7f552affd640 1 -- 172.21.15.106:0/3500217874 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552402cbb0 con 0x7f552c151690 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.065+0000 7f552affd640 1 -- 172.21.15.106:0/3500217874 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552402cd50 con 0x7f552c151690 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.065+0000 7f552affd640 1 -- 172.21.15.106:0/3500217874 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524034610 con 0x7f552c151690 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.066+0000 7f5532a2c640 1 -- 172.21.15.106:0/3500217874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c151690 msgr2=0x7f552c153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.066+0000 7f5532a2c640 1 --2- 172.21.15.106:0/3500217874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c151690 0x7f552c153a80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5524009e50 tx=0x7f552402c010 comp rx=0 tx=0).stop 2024-04-16T12:57:31.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.066+0000 7f5532a2c640 1 -- 172.21.15.106:0/3500217874 shutdown_connections 2024-04-16T12:57:31.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.066+0000 7f5532a2c640 1 --2- 172.21.15.106:0/3500217874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c151690 0x7f552c153a80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.066+0000 7f5532a2c640 1 -- 172.21.15.106:0/3500217874 >> 172.21.15.106:0/3500217874 conn(0x7f552c06bbf0 msgr2=0x7f552c06c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.066+0000 7f5532a2c640 1 -- 172.21.15.106:0/3500217874 shutdown_connections 2024-04-16T12:57:31.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.066+0000 7f5532a2c640 1 -- 172.21.15.106:0/3500217874 wait complete. 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 Processor -- start 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 -- start start 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c0b68f0 0x7f552c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f552c141bf0 0x7f552c1e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f552c151690 0x7f552c1e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f552c0b1460 con 0x7f552c0b68f0 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f552c0b20b0 con 0x7f552c151690 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.067+0000 7f5532a2c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f552c0b3900 con 0x7f552c141bf0 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c0b68f0 0x7f552c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c0b68f0 0x7f552c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43228/0 (socket says 172.21.15.106:43228) 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 -- 172.21.15.106:0/316425202 learned_addr learned my addr 172.21.15.106:0/316425202 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f5530fc9640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f552c151690 0x7f552c1e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 -- 172.21.15.106:0/316425202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f552c141bf0 msgr2=0x7f552c1e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f552c141bf0 0x7f552c1e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 -- 172.21.15.106:0/316425202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f552c151690 msgr2=0x7f552c1e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f552c151690 0x7f552c1e1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 -- 172.21.15.106:0/316425202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c142a40 con 0x7f552c0b68f0 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f552bfff640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c0b68f0 0x7f552c133da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f551c00c3c0 tx=0x7f551c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f5528ff9640 1 -- 172.21.15.106:0/316425202 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c017070 con 0x7f552c0b68f0 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f5528ff9640 1 -- 172.21.15.106:0/316425202 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c0035f0 con 0x7f552c0b68f0 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f5528ff9640 1 -- 172.21.15.106:0/316425202 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c0039e0 con 0x7f552c0b68f0 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552c134ae0 con 0x7f552c0b68f0 2024-04-16T12:57:31.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.068+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552c145310 con 0x7f552c0b68f0 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.070+0000 7f5528ff9640 1 -- 172.21.15.106:0/316425202 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f551c01a070 con 0x7f552c0b68f0 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.070+0000 7f5528ff9640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f550c06c8f0 0x7f550c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.070+0000 7f5528ff9640 1 -- 172.21.15.106:0/316425202 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f551c08ae70 con 0x7f552c0b68f0 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.070+0000 7f552b7fe640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f550c06c8f0 0x7f550c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.071+0000 7f552b7fe640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f550c06c8f0 0x7f550c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5514000f60 tx=0x7f55140079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.071+0000 7f553560f740 1 Processor -- start 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.071+0000 7f553560f740 1 -- start start 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c2f54e0 0x55588c31dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c319610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f553560f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c319b50 0x55588c324830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f553560f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55588c25a9c0 con 0x55588c319b50 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55588c201650 con 0x55588c31e1c0 2024-04-16T12:57:31.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55588c256980 con 0x55588c2f54e0 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c319b50 0x55588c324830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c319b50 0x55588c324830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43244/0 (socket says 172.21.15.106:43244) 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 -- 172.21.15.106:0/2646891491 learned_addr learned my addr 172.21.15.106:0/2646891491 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f552b7fe640 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c319610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f552bfff640 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c2f54e0 0x55588c31dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 -- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c2f54e0 msgr2=0x55588c31dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c2f54e0 0x55588c31dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 -- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 msgr2=0x55588c319610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c319610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 -- 172.21.15.106:0/2646891491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55588bf6d2d0 con 0x55588c319b50 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5530fc9640 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c319b50 0x55588c324830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5524009f70 tx=0x7f552402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d33fdc9ebe816c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5521ffb640 1 -- 172.21.15.106:0/2646891491 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552402cbb0 con 0x55588c319b50 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5521ffb640 1 -- 172.21.15.106:0/2646891491 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552402cd50 con 0x55588c319b50 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.072+0000 7f5521ffb640 1 -- 172.21.15.106:0/2646891491 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524003bd0 con 0x55588c319b50 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 -- 172.21.15.106:0/2646891491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c319b50 msgr2=0x55588c324830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c319b50 0x55588c324830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5524009f70 tx=0x7f552402e000 comp rx=0 tx=0).stop 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 -- 172.21.15.106:0/2646891491 shutdown_connections 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c319b50 0x55588c324830 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c319610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 --2- 172.21.15.106:0/2646891491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c2f54e0 0x55588c31dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 -- 172.21.15.106:0/2646891491 >> 172.21.15.106:0/2646891491 conn(0x55588c2f2ab0 msgr2=0x55588c2f4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 -- 172.21.15.106:0/2646891491 shutdown_connections 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 -- 172.21.15.106:0/2646891491 wait complete. 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.073+0000 7f553560f740 1 -- start start 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 1 Processor -- start 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c317810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c31e1c0 0x55588c31c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c320fe0 0x55588c31cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55588c31e640 con 0x55588c31e1c0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55588c214a10 con 0x55588c319b50 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55588c324250 con 0x55588c320fe0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f553560f740 10 client.0 _ll_register_callbacks cb 0x55588c214400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f552b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c31e1c0 0x55588c31c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f552b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c31e1c0 0x55588c31c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43260/0 (socket says 172.21.15.106:43260) 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f552b7fe640 1 -- 172.21.15.106:0/2703206518 learned_addr learned my addr 172.21.15.106:0/2703206518 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f552bfff640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c317810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.074+0000 7f5530fc9640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c320fe0 0x55588c31cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552b7fe640 1 -- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c320fe0 msgr2=0x55588c31cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552b7fe640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c320fe0 0x55588c31cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552b7fe640 1 -- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 msgr2=0x55588c317810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552b7fe640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c317810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552b7fe640 1 -- 172.21.15.106:0/2703206518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55588c0376b0 con 0x55588c31e1c0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552bfff640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c317810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552b7fe640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c31e1c0 0x55588c31c6b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f552c145d30 tx=0x7f5514001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd1bcf5b25343d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f550affd640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f550affd640 1 -- 172.21.15.106:0/2703206518 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514005320 con 0x55588c31e1c0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f550affd640 1 -- 172.21.15.106:0/2703206518 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5514023ac0 con 0x55588c31e1c0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f552402cd50 con 0x55588c31e1c0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f550affd640 1 -- 172.21.15.106:0/2703206518 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5514023cc0 con 0x55588c31e1c0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 10 client.4656 fetch_fsmap learned FSMap version 6 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55588c318830 con 0x55588c31e1c0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f550affd640 1 -- 172.21.15.106:0/2703206518 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552402cd50 con 0x55588c31e1c0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f550affd640 1 -- 172.21.15.106:0/2703206518 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f551402b420 con 0x55588c31e1c0 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 10 client.4656 fetch_fsmap finished waiting for FSMap version 6 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 10 client.4656 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 20 client.4656 populate_metadata read hostname 'smithi106' 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c316480 0x55588c3437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 4 client.4656 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T12:57:31.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 --> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55588c2683e0 con 0x55588c316480 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.075+0000 7f552bfff640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c316480 0x55588c3437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f550affd640 10 client.4656 ms_handle_connect on v2:172.21.15.106:6834/1351002879 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f552bfff640 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c316480 0x55588c3437f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f12e93a88d0ab86 server_cookie=4fc53085f6d5f128 in_seq=0 out_seq=0 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f550affd640 1 -- 172.21.15.106:0/2703206518 <== mds.0 v2:172.21.15.106:6834/1351002879 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55588c2683e0 con 0x55588c316480 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f550affd640 10 client.4656 handle_command_reply: tid=0 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f553560f740 1 client.4656 shutdown 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c31e1c0 msgr2=0x55588c31c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f553560f740 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c31e1c0 0x55588c31c6b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f552c145d30 tx=0x7f5514001080 comp rx=0 tx=0).stop 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 shutdown_connections 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f553560f740 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c316480 0x55588c3437f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f553560f740 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c320fe0 0x55588c31cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.076+0000 7f553560f740 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c31e1c0 0x55588c31c6b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.077+0000 7f553560f740 1 --2- 172.21.15.106:0/2703206518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c317810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.077+0000 7f550affd640 0 client.4656 ms_handle_reset on v2:172.21.15.106:6834/1351002879 2024-04-16T12:57:31.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.077+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 >> 172.21.15.106:0/2703206518 conn(0x55588c2f54e0 msgr2=0x55588c2f58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.077+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 shutdown_connections 2024-04-16T12:57:31.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.077+0000 7f553560f740 1 -- 172.21.15.106:0/2703206518 wait complete. 2024-04-16T12:57:31.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.077+0000 7f553560f740 20 client.4656 trim_cache size 0 max 16384 2024-04-16T12:57:31.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.094+0000 7f553560f740 1 Processor -- start 2024-04-16T12:57:31.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.094+0000 7f553560f740 1 -- start start 2024-04-16T12:57:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c2ec4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c31e1c0 0x55588c319270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f553560f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c31fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f553560f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55588c321ee0 con 0x55588c320fe0 2024-04-16T12:57:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f552c1ea1d0 con 0x55588c319b50 2024-04-16T12:57:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f552c1e9330 con 0x55588c31e1c0 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c31fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c31fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43274/0 (socket says 172.21.15.106:43274) 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 -- 172.21.15.106:0/1940076968 learned_addr learned my addr 172.21.15.106:0/1940076968 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 -- 172.21.15.106:0/1940076968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c31e1c0 msgr2=0x55588c319270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 --2- 172.21.15.106:0/1940076968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c31e1c0 0x55588c319270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 -- 172.21.15.106:0/1940076968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 msgr2=0x55588c2ec4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 --2- 172.21.15.106:0/1940076968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c2ec4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 -- 172.21.15.106:0/1940076968 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55588c31ea00 con 0x55588c320fe0 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.095+0000 7f5530fc9640 1 --2- 172.21.15.106:0/1940076968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c31fdf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5524009f40 tx=0x7f5524009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627b36d704af8c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f55217fa640 1 -- 172.21.15.106:0/1940076968 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552402c9b0 con 0x55588c320fe0 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f55217fa640 1 -- 172.21.15.106:0/1940076968 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552402cb70 con 0x55588c320fe0 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f55217fa640 1 -- 172.21.15.106:0/1940076968 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524003bd0 con 0x55588c320fe0 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 -- 172.21.15.106:0/1940076968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 msgr2=0x55588c31fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 --2- 172.21.15.106:0/1940076968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c31fdf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5524009f40 tx=0x7f5524009000 comp rx=0 tx=0).stop 2024-04-16T12:57:31.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 -- 172.21.15.106:0/1940076968 shutdown_connections 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 --2- 172.21.15.106:0/1940076968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c31fdf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 --2- 172.21.15.106:0/1940076968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c31e1c0 0x55588c319270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 --2- 172.21.15.106:0/1940076968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c319b50 0x55588c2ec4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 -- 172.21.15.106:0/1940076968 >> 172.21.15.106:0/1940076968 conn(0x55588c2f54e0 msgr2=0x55588c322080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 -- 172.21.15.106:0/1940076968 shutdown_connections 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.096+0000 7f553560f740 1 -- 172.21.15.106:0/1940076968 wait complete. 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.097+0000 7f553560f740 1 -- start start 2024-04-16T12:57:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.097+0000 7f553560f740 1 Processor -- start 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.097+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c319b50 0x55588c324aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c315440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c327dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55588c31d130 con 0x55588c320fe0 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55588c3172f0 con 0x55588c31e1c0 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55588c332930 con 0x55588c319b50 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 10 client.0 _ll_register_callbacks cb 0x7f5514014930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c327dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c327dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43282/0 (socket says 172.21.15.106:43282) 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 -- 172.21.15.106:0/2479749494 learned_addr learned my addr 172.21.15.106:0/2479749494 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f552bfff640 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c319b50 0x55588c324aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f552b7fe640 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c315440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 -- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c319b50 msgr2=0x55588c324aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c319b50 0x55588c324aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 -- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 msgr2=0x55588c315440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c315440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 -- 172.21.15.106:0/2479749494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55588c2f1d20 con 0x55588c320fe0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f5530fc9640 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c327dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f552402c050 tx=0x7f5524004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a14b03aa03c788 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f550affd640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f550affd640 1 -- 172.21.15.106:0/2479749494 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524057030 con 0x55588c320fe0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f550affd640 1 -- 172.21.15.106:0/2479749494 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f552404c040 con 0x55588c320fe0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f552402cb70 con 0x55588c320fe0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f550affd640 1 -- 172.21.15.106:0/2479749494 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5524003e60 con 0x55588c320fe0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 10 client.4662 fetch_fsmap learned FSMap version 6 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55588c31c970 con 0x55588c320fe0 2024-04-16T12:57:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.098+0000 7f550affd640 1 -- 172.21.15.106:0/2479749494 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552402cb70 con 0x55588c320fe0 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f550affd640 1 -- 172.21.15.106:0/2479749494 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f5524008050 con 0x55588c320fe0 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 10 client.4662 fetch_fsmap finished waiting for FSMap version 6 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 10 client.4662 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 20 client.4662 populate_metadata read hostname 'smithi106' 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c3287c0 0x55588c39b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 4 client.4662 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 --> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] -- command(tid 0: {"prefix": "status"}) -- 0x55588c31aa20 con 0x55588c3287c0 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f552bfff640 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c3287c0 0x55588c39b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f550affd640 10 client.4662 ms_handle_connect on v2:172.21.15.106:6834/1351002879 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f552bfff640 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c3287c0 0x55588c39b680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101165c30c1a8580 server_cookie=883fdf4d91bd8c34 in_seq=0 out_seq=0 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f550affd640 1 -- 172.21.15.106:0/2479749494 <== mds.0 v2:172.21.15.106:6834/1351002879 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55588c31aa20 con 0x55588c3287c0 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f550affd640 10 client.4662 handle_command_reply: tid=0 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 client.4662 shutdown 2024-04-16T12:57:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 msgr2=0x55588c327dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c327dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f552402c050 tx=0x7f5524004ab0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 shutdown_connections 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:6834/1351002879,v1:172.21.15.106:6835/1351002879] conn(0x55588c3287c0 0x55588c39b680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55588c320fe0 0x55588c327dc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55588c31e1c0 0x55588c315440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f550affd640 0 client.4662 ms_handle_reset on v2:172.21.15.106:6834/1351002879 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 --2- 172.21.15.106:0/2479749494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55588c319b50 0x55588c324aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 >> 172.21.15.106:0/2479749494 conn(0x55588c2f54e0 msgr2=0x55588c3174d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 shutdown_connections 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.099+0000 7f553560f740 1 -- 172.21.15.106:0/2479749494 wait complete. 2024-04-16T12:57:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f553560f740 20 client.4662 trim_cache size 0 max 16384 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "2138f2ff-23aa-427d-a47c-cfcd7bf8d143", 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4275, 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 12.208706118, 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 6, 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 20, 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 20, 2024-04-16T12:57:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 19.340441849000001 2024-04-16T12:57:31.113 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:57:31.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f550c06c8f0 msgr2=0x7f550c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f550c06c8f0 0x7f550c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5514000f60 tx=0x7f55140079b0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c0b68f0 msgr2=0x7f552c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c0b68f0 0x7f552c133da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f551c00c3c0 tx=0x7f551c00c880 comp rx=0 tx=0).stop 2024-04-16T12:57:31.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 shutdown_connections 2024-04-16T12:57:31.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f550c06c8f0 0x7f550c06edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f552c151690 0x7f552c1e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f552c141bf0 0x7f552c1e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 --2- 172.21.15.106:0/316425202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f552c0b68f0 0x7f552c133da0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 >> 172.21.15.106:0/316425202 conn(0x7f552c06bbf0 msgr2=0x7f552c0b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 shutdown_connections 2024-04-16T12:57:31.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.100+0000 7f5532a2c640 1 -- 172.21.15.106:0/316425202 wait complete. 2024-04-16T12:57:31.115 INFO:teuthology.run_tasks:Running task sequential... 2024-04-16T12:57:31.125 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-16T12:57:31.125 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-16T12:57:31.126 INFO:teuthology.task.print:Enabling mgr modules 2024-04-16T12:57:31.126 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-16T12:57:31.174 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-16T12:57:31.174 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-16T12:57:31.175 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-16T12:57:31.175 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T12:57:31.175 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:31.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:31.175 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-16T12:57:31.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:31.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-04-16T12:57:31.262 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-04-16T12:57:31.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:57:31.263 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-16T12:57:31.263 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T12:57:31.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.405+0000 7f5cc718d640 1 Processor -- start 2024-04-16T12:57:31.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.405+0000 7f5cc718d640 1 -- start start 2024-04-16T12:57:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc718d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5cc00679d0 0x7f5cc00b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc718d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5cc009fb60 0x7f5cc00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc718d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc0067db0 con 0x7f5cc00b0ac0 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc718d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc00b45f0 con 0x7f5cc00679d0 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc718d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc00b01c0 con 0x7f5cc009fb60 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc4f29640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5cc00679d0 0x7f5cc00b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc4f29640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5cc00679d0 0x7f5cc00b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43286/0 (socket says 172.21.15.106:43286) 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc4f29640 1 -- 172.21.15.106:0/785492376 learned_addr learned my addr 172.21.15.106:0/785492376 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc4f29640 1 -- 172.21.15.106:0/785492376 >> v2:172.21.15.171:3300/0 conn(0x7f5cc009fb60 msgr2=0x7f5cc00afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc572a640 1 --2- 172.21.15.106:0/785492376 >> v2:172.21.15.171:3300/0 conn(0x7f5cc009fb60 0x7f5cc00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc4f29640 1 --2- 172.21.15.106:0/785492376 >> v2:172.21.15.171:3300/0 conn(0x7f5cc009fb60 0x7f5cc00afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc4f29640 1 -- 172.21.15.106:0/785492376 >> v1:172.21.15.171:6789/0 conn(0x7f5cc00b0ac0 legacy=0x7f5cc0144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.406+0000 7f5cc4f29640 1 -- 172.21.15.106:0/785492376 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc00b5b10 con 0x7f5cc00679d0 2024-04-16T12:57:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.407+0000 7f5cc4f29640 1 --2- 172.21.15.106:0/785492376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc00b4a80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cc009f650 tx=0x7f5cb002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d919ee370804cb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.407+0000 7f5cbf7fe640 1 -- 172.21.15.106:0/785492376 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb002ca80 con 0x7f5cc00679d0 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.407+0000 7f5cbf7fe640 1 -- 172.21.15.106:0/785492376 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb002cc20 con 0x7f5cc00679d0 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.407+0000 7f5cbf7fe640 1 -- 172.21.15.106:0/785492376 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00343f0 con 0x7f5cc00679d0 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 -- 172.21.15.106:0/785492376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 msgr2=0x7f5cc00b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 --2- 172.21.15.106:0/785492376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc00b4a80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cc009f650 tx=0x7f5cb002bee0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 -- 172.21.15.106:0/785492376 shutdown_connections 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 --2- 172.21.15.106:0/785492376 >> v2:172.21.15.171:3300/0 conn(0x7f5cc009fb60 0x7f5cc00afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 --2- 172.21.15.106:0/785492376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc00b4a80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 -- 172.21.15.106:0/785492376 >> 172.21.15.106:0/785492376 conn(0x7f5cc00b9ca0 msgr2=0x7f5cc00ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 -- 172.21.15.106:0/785492376 shutdown_connections 2024-04-16T12:57:31.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.408+0000 7f5cc718d640 1 -- 172.21.15.106:0/785492376 wait complete. 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 Processor -- start 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 -- start start 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc013ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc009fb60 0x7f5cc01dde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc00b0ac0 0x7f5cc01de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc0145450 con 0x7f5cc00679d0 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc00b57d0 con 0x7f5cc00b0ac0 2024-04-16T12:57:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.409+0000 7f5cc718d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc01455d0 con 0x7f5cc009fb60 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc013ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc013ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43294/0 (socket says 172.21.15.106:43294) 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 -- 172.21.15.106:0/2252225630 learned_addr learned my addr 172.21.15.106:0/2252225630 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc572a640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc00b0ac0 0x7f5cc01de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 -- 172.21.15.106:0/2252225630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc009fb60 msgr2=0x7f5cc01dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc009fb60 0x7f5cc01dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 -- 172.21.15.106:0/2252225630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc00b0ac0 msgr2=0x7f5cc01de3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc00b0ac0 0x7f5cc01de3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 -- 172.21.15.106:0/2252225630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc013fe30 con 0x7f5cc00679d0 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc4f29640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc013ea70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009f40 tx=0x7f5cb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cbd7fa640 1 -- 172.21.15.106:0/2252225630 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0043020 con 0x7f5cc00679d0 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cbd7fa640 1 -- 172.21.15.106:0/2252225630 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb003e450 con 0x7f5cc00679d0 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc00b2120 con 0x7f5cc00679d0 2024-04-16T12:57:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cbd7fa640 1 -- 172.21.15.106:0/2252225630 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0009510 con 0x7f5cc00679d0 2024-04-16T12:57:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.410+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc013d9b0 con 0x7f5cc00679d0 2024-04-16T12:57:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.411+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc0073bd0 con 0x7f5cc00679d0 2024-04-16T12:57:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.412+0000 7f5cbd7fa640 1 -- 172.21.15.106:0/2252225630 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5cb0046020 con 0x7f5cc00679d0 2024-04-16T12:57:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.412+0000 7f5cbd7fa640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5cac06c920 0x7f5cac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.412+0000 7f5cbffff640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5cac06c920 0x7f5cac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.412+0000 7f5cbd7fa640 1 -- 172.21.15.106:0/2252225630 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5cb00ae220 con 0x7f5cc00679d0 2024-04-16T12:57:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.412+0000 7f5cbffff640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5cac06c920 0x7f5cac06ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5cc013dc10 tx=0x7f5cb40079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:31.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.416+0000 7f5cbd7fa640 1 -- 172.21.15.106:0/2252225630 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5cc0073bd0 con 0x7f5cc00679d0 2024-04-16T12:57:31.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.628+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5cc0068a90 con 0x7f5cc00679d0 2024-04-16T12:57:31.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.629+0000 7f5cbd7fa640 1 -- 172.21.15.106:0/2252225630 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f5cb004d070 con 0x7f5cc00679d0 2024-04-16T12:57:31.630 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T12:57:31.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.630+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5cac06c920 msgr2=0x7f5cac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.630+0000 7f5cc718d640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5cac06c920 0x7f5cac06ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5cc013dc10 tx=0x7f5cb40079b0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.630+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 msgr2=0x7f5cc013ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:31.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.630+0000 7f5cc718d640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc013ea70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009f40 tx=0x7f5cb0004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 shutdown_connections 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5cac06c920 0x7f5cac06ede0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc00b0ac0 0x7f5cc01de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc009fb60 0x7f5cc01dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 --2- 172.21.15.106:0/2252225630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc00679d0 0x7f5cc013ea70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 >> 172.21.15.106:0/2252225630 conn(0x7f5cc00b9ca0 msgr2=0x7f5cc00b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 shutdown_connections 2024-04-16T12:57:31.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31.631+0000 7f5cc718d640 1 -- 172.21.15.106:0/2252225630 wait complete. 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T12:57:31.643 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T12:57:31.644 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T12:57:31.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:31.644 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-04-16T12:57:31.659 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-04-16T12:57:31.660 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:57:31.661 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-04-16T12:57:31.661 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T12:57:31.661 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-04-16T12:57:31.661 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T12:57:31.661 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42680sec preferred_lft 42680sec 2024-04-16T12:57:31.661 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-04-16T12:57:31.661 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:57:31.661 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T12:57:31.662 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:57:31.662 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-16T12:57:31.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2024-04-16T12:57:31.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2024-04-16T12:57:31.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2024-04-16T12:57:31.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T12:57:31.662 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-16T12:57:31.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:57:31.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:57:31.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:31.886 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T12:57:31.916 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-16T12:57:31.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:31.918 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-04-16T12:57:31.994 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-04-16T12:57:31.994 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T12:57:31.994 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T12:57:31.994 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T12:57:31.994 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T12:57:31.995 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:57:31.995 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-16T12:57:31.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T12:57:31.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T12:57:31.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T12:57:31.995 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-16T12:57:32.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:57:32.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:57:32.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:32.308 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-16T12:57:32.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:32.324 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-04-16T12:57:32.379 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:57:32.380 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-16T12:57:32.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:57:32.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-16T12:57:32.380 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-16T12:57:32.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:57:32.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:57:32.504 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-16T12:57:32.504 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-16T12:57:32.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:57:32.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:57:32.642 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:57:32.643 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-16T12:57:32.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-04-16T12:57:32.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T12:57:32.643 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-16T12:57:32.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:57:32.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:57:32.727 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-16T12:57:32.727 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:57:32.727 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:32.742 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T12:57:32.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:57:32.746 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:32.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-16T12:57:32.867 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T12:57:32.924 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-16T12:57:32.924 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-16T12:57:32.924 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-16T12:57:32.924 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-16T12:57:32.924 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-16T12:57:32.924 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/selinux 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T12:57:32.925 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:57:32.926 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:57:32.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:32.927 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-16T12:57:32.980 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T12:57:32.980 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-16T12:57:33.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-16T12:57:33.051 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-16T12:57:33.108 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/selinux 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T12:57:33.109 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:57:33.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:33.111 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-16T12:57:33.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:2024-04-16T12:57:33.110+0000 7fade143f480 -1 init, newargv = 0x56439f3676d0 newargc=15 2024-04-16T12:57:33.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:ceph-fuse[45882]: starting ceph client 2024-04-16T12:57:33.115 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:ceph-fuse[45882]: starting fuse 2024-04-16T12:57:33.126 INFO:teuthology.orchestra.run.smithi106.stdout:41 2024-04-16T12:57:33.127 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T12:57:33.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo stdin-killer -- python3 -c ' 2024-04-16T12:57:33.127 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2024-04-16T12:57:33.127 DEBUG:teuthology.orchestra.run.smithi106:> import re 2024-04-16T12:57:33.127 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-16T12:57:33.127 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T12:57:33.128 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> return f 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.0")) 2024-04-16T12:57:33.129 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-16T12:57:33.249 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.0.45882.asok 2024-04-16T12:57:33.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:57:33.260 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45882.asok 2024-04-16T12:57:33.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:33.260 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45882.asok status 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "0", 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "45882", 2024-04-16T12:57:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4677, 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4677 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3572066407 2024-04-16T12:57:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3572066407 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.4677 192.168.0.1:0/3572066407", 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "192.168.0.1:0/3572066407", 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 6, 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 20, 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2024-04-16T12:57:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2024-04-16T12:57:33.402 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:57:33.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:33.408 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2024-04-16T12:57:33.408 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:33.424 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2024-04-16T12:57:33.424 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:33.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:33.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:33.493 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-16T12:57:33.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:33.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.635+0000 7f3311688640 1 Processor -- start 2024-04-16T12:57:33.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f3311688640 1 -- start start 2024-04-16T12:57:33.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f3311688640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f330c0b63a0 0x7f330c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f3311688640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c1481c0 0x7f330c1418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f3311688640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330c148b70 con 0x7f330c148640 2024-04-16T12:57:33.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f3311688640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0b4bd0 con 0x7f330c0b63a0 2024-04-16T12:57:33.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f3311688640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f330c0b4eb0 con 0x7f330c1481c0 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f330b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f330c148640 0x7f330c0b53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59386/0 (socket says 172.21.15.106:59386) 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f330b7fe640 1 -- 172.21.15.106:0/4028278870 learned_addr learned my addr 172.21.15.106:0/4028278870 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f330affd640 1 --2- 172.21.15.106:0/4028278870 >> v2:172.21.15.171:3300/0 conn(0x7f330c0b63a0 0x7f330c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.636+0000 7f330a7fc640 1 --2- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c1481c0 0x7f330c1418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.637+0000 7f3309ffb640 1 -- 172.21.15.106:0/4028278870 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197529746 0 0) 0x7f330c148b70 con 0x7f330c148640 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.637+0000 7f3309ffb640 1 -- 172.21.15.106:0/4028278870 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32f4003520 con 0x7f330c148640 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.637+0000 7f330affd640 1 -- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c1481c0 msgr2=0x7f330c1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.637+0000 7f330affd640 1 --2- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c1481c0 0x7f330c1418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.637+0000 7f330affd640 1 -- 172.21.15.106:0/4028278870 >> v1:172.21.15.106:6789/0 conn(0x7f330c148640 legacy=0x7f330c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.637+0000 7f3309ffb640 1 -- 172.21.15.106:0/4028278870 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1765129863 0 0) 0x7f32f4003520 con 0x7f330c148640 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.637+0000 7f330affd640 1 -- 172.21.15.106:0/4028278870 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0b5ae0 con 0x7f330c0b63a0 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f330affd640 1 --2- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c0b63a0 0x7f330c0b6780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097a0 tx=0x7f32fc02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55cbdb879e452a45 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:33.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3309ffb640 1 -- 172.21.15.106:0/4028278870 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc037070 con 0x7f330c0b63a0 2024-04-16T12:57:33.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3309ffb640 1 -- 172.21.15.106:0/4028278870 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc030510 con 0x7f330c0b63a0 2024-04-16T12:57:33.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3309ffb640 1 -- 172.21.15.106:0/4028278870 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33040019f0 con 0x7f330c0b63a0 2024-04-16T12:57:33.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 -- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c0b63a0 msgr2=0x7f330c0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 --2- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c0b63a0 0x7f330c0b6780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097a0 tx=0x7f32fc02b710 comp rx=0 tx=0).stop 2024-04-16T12:57:33.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 -- 172.21.15.106:0/4028278870 shutdown_connections 2024-04-16T12:57:33.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 --2- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c1481c0 0x7f330c1418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 --2- 172.21.15.106:0/4028278870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c0b63a0 0x7f330c0b6780 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 -- 172.21.15.106:0/4028278870 >> 172.21.15.106:0/4028278870 conn(0x7f330c068080 msgr2=0x7f330c0bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 -- 172.21.15.106:0/4028278870 shutdown_connections 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.638+0000 7f3311688640 1 -- 172.21.15.106:0/4028278870 wait complete. 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.639+0000 7f3311688640 1 Processor -- start 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f3311688640 1 -- start start 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f3311688640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c0b63a0 0x7f330c149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f3311688640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c1481c0 0x7f330c142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f3311688640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f330c148640 0x7f330c1436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f3311688640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f330c142170 con 0x7f330c148640 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f3311688640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f330c141ff0 con 0x7f330c1481c0 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f3311688640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f330c152610 con 0x7f330c0b63a0 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f330c148640 0x7f330c1436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f330c148640 0x7f330c1436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:32994/0 (socket says 172.21.15.106:32994) 2024-04-16T12:57:33.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f330b7fe640 1 -- 172.21.15.106:0/934956577 learned_addr learned my addr 172.21.15.106:0/934956577 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f330a7fc640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c1481c0 0x7f330c142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f330affd640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c0b63a0 0x7f330c149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f330b7fe640 1 -- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c0b63a0 msgr2=0x7f330c149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.640+0000 7f330b7fe640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c0b63a0 0x7f330c149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f330b7fe640 1 -- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c1481c0 msgr2=0x7f330c142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f330b7fe640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c1481c0 0x7f330c142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f330b7fe640 1 -- 172.21.15.106:0/934956577 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c14bd50 con 0x7f330c148640 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f330affd640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c0b63a0 0x7f330c149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f330b7fe640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f330c148640 0x7f330c1436e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f330400cc90 tx=0x7f330400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f32f37fe640 1 -- 172.21.15.106:0/934956577 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330400ce40 con 0x7f330c148640 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f32f37fe640 1 -- 172.21.15.106:0/934956577 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3304012400 con 0x7f330c148640 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f32f37fe640 1 -- 172.21.15.106:0/934956577 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33040127f0 con 0x7f330c148640 2024-04-16T12:57:33.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c149d10 con 0x7f330c148640 2024-04-16T12:57:33.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.641+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c14c2a0 con 0x7f330c148640 2024-04-16T12:57:33.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.642+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330c068a90 con 0x7f330c148640 2024-04-16T12:57:33.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.642+0000 7f32f37fe640 1 -- 172.21.15.106:0/934956577 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3304012990 con 0x7f330c148640 2024-04-16T12:57:33.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.643+0000 7f32f37fe640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32f806c8f0 0x7f32f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.643+0000 7f32f37fe640 1 -- 172.21.15.106:0/934956577 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f330408c240 con 0x7f330c148640 2024-04-16T12:57:33.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.643+0000 7f330affd640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32f806c8f0 0x7f32f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.643+0000 7f330affd640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32f806c8f0 0x7f32f806edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32fc034000 tx=0x7f32fc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:33.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.647+0000 7f32f37fe640 1 -- 172.21.15.106:0/934956577 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33040182b0 con 0x7f330c148640 2024-04-16T12:57:33.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.824+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f330c146010 con 0x7f330c148640 2024-04-16T12:57:33.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.825+0000 7f32f37fe640 1 -- 172.21.15.106:0/934956577 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f330405a700 con 0x7f330c148640 2024-04-16T12:57:33.827 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:33.827 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32f806c8f0 msgr2=0x7f32f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32f806c8f0 0x7f32f806edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32fc034000 tx=0x7f32fc008030 comp rx=0 tx=0).stop 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f330c148640 msgr2=0x7f330c1436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f330c148640 0x7f330c1436e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f330400cc90 tx=0x7f330400a430 comp rx=0 tx=0).stop 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 shutdown_connections 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32f806c8f0 0x7f32f806edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f330c148640 0x7f330c1436e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f330c1481c0 0x7f330c142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 --2- 172.21.15.106:0/934956577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f330c0b63a0 0x7f330c149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 >> 172.21.15.106:0/934956577 conn(0x7f330c068080 msgr2=0x7f330c146810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:33.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 shutdown_connections 2024-04-16T12:57:33.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.827+0000 7f3311688640 1 -- 172.21.15.106:0/934956577 wait complete. 2024-04-16T12:57:33.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:33.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:33.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.947+0000 7fdd46c88640 1 Processor -- start 2024-04-16T12:57:33.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.947+0000 7fdd46c88640 1 -- start start 2024-04-16T12:57:33.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd46c88640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdd400737f0 0x7fdd40149110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd46c88640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd40073bd0 con 0x7fdd400b6bb0 2024-04-16T12:57:33.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd46c88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd400b47f0 con 0x7fdd400b39e0 2024-04-16T12:57:33.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd46c88640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdd400b2d50 con 0x7fdd400737f0 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd3ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdd400b6bb0 0x7fdd4013f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59394/0 (socket says 172.21.15.106:59394) 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd3ffff640 1 -- 172.21.15.106:0/3361192164 learned_addr learned my addr 172.21.15.106:0/3361192164 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd44a24640 1 --2- 172.21.15.106:0/3361192164 >> v2:172.21.15.171:3300/0 conn(0x7fdd400737f0 0x7fdd40149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463500792 0 0) 0x7fdd40073bd0 con 0x7fdd400b6bb0 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.948+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd28003520 con 0x7fdd400b6bb0 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1750195734 0 0) 0x7fdd28003520 con 0x7fdd400b6bb0 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 >> v2:172.21.15.171:3300/0 conn(0x7fdd400737f0 msgr2=0x7fdd40149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 --2- 172.21.15.106:0/3361192164 >> v2:172.21.15.171:3300/0 conn(0x7fdd400737f0 0x7fdd40149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 >> v1:172.21.15.171:6789/0 conn(0x7fdd400b39e0 legacy=0x7fdd401504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd400b31e0 con 0x7fdd400b6bb0 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fdd34001690 con 0x7fdd400b6bb0 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 >> v1:172.21.15.106:6789/0 conn(0x7fdd400b6bb0 legacy=0x7fdd4013f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280039b0 0x7fdd28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd28004800 0x7fdd28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd280052e0 0x7fdd2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400b2d50 con 0x7fdd280052e0 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2800c1b0 con 0x7fdd280039b0 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2800c3b0 con 0x7fdd28004800 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd45225640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd280052e0 0x7fdd2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd44a24640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280039b0 0x7fdd28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd3ffff640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd28004800 0x7fdd28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd45225640 1 -- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd28004800 msgr2=0x7fdd28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:33.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd45225640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd28004800 0x7fdd28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd45225640 1 -- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280039b0 msgr2=0x7fdd28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd45225640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280039b0 0x7fdd28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.949+0000 7fdd45225640 1 -- 172.21.15.106:0/3361192164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd28003520 con 0x7fdd280052e0 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd45225640 1 -- 172.21.15.106:0/3361192164 reap_dead start 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd45225640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd280052e0 0x7fdd2800b9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd38001e20 tx=0x7fdd28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d050ff8fab8b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38001a70 con 0x7fdd280052e0 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd38003b70 con 0x7fdd280052e0 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd3f7fe640 1 -- 172.21.15.106:0/3361192164 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd380050d0 con 0x7fdd280052e0 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd46c88640 1 -- 172.21.15.106:0/3361192164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd280052e0 msgr2=0x7fdd2800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd280052e0 0x7fdd2800b9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd38001e20 tx=0x7fdd28005830 comp rx=0 tx=0).stop 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd46c88640 1 -- 172.21.15.106:0/3361192164 shutdown_connections 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3361192164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd280052e0 0x7fdd2800b9c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd46c88640 1 -- 172.21.15.106:0/3361192164 >> 172.21.15.106:0/3361192164 conn(0x7fdd400ba4d0 msgr2=0x7fdd400ba8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:33.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd46c88640 1 -- 172.21.15.106:0/3361192164 shutdown_connections 2024-04-16T12:57:33.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.950+0000 7fdd46c88640 1 -- 172.21.15.106:0/3361192164 wait complete. 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.951+0000 7fdd46c88640 1 Processor -- start 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.951+0000 7fdd46c88640 1 -- start start 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd46c88640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280052e0 0x7fdd400b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd46c88640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd401cf130 0x7fdd401de690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd46c88640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd401cf590 0x7fdd401debd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd46c88640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400b1b50 con 0x7fdd401cf590 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd46c88640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400b19d0 con 0x7fdd280052e0 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd46c88640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd400b1cd0 con 0x7fdd401cf130 2024-04-16T12:57:33.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd45225640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd401cf590 0x7fdd401debd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd45225640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd401cf590 0x7fdd401debd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33022/0 (socket says 172.21.15.106:33022) 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd45225640 1 -- 172.21.15.106:0/3804965221 learned_addr learned my addr 172.21.15.106:0/3804965221 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd44a24640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280052e0 0x7fdd400b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.952+0000 7fdd3ffff640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd401cf130 0x7fdd401de690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd45225640 1 -- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd401cf130 msgr2=0x7fdd401de690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd45225640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd401cf130 0x7fdd401de690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd45225640 1 -- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280052e0 msgr2=0x7fdd400b97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd45225640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280052e0 0x7fdd400b97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd45225640 1 -- 172.21.15.106:0/3804965221 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd401cfa70 con 0x7fdd401cf590 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd45225640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd401cf590 0x7fdd401debd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd38001f40 tx=0x7fdd380014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd3d7fa640 1 -- 172.21.15.106:0/3804965221 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38037460 con 0x7fdd401cf590 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd3d7fa640 1 -- 172.21.15.106:0/3804965221 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd38037600 con 0x7fdd401cf590 2024-04-16T12:57:33.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd40142dd0 con 0x7fdd401cf590 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd3d7fa640 1 -- 172.21.15.106:0/3804965221 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd380379f0 con 0x7fdd401cf590 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.953+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd400b1600 con 0x7fdd401cf590 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.954+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd40068a90 con 0x7fdd401cf590 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.954+0000 7fdd3d7fa640 1 -- 172.21.15.106:0/3804965221 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd38037b90 con 0x7fdd401cf590 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.955+0000 7fdd3d7fa640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdd2c06c8f0 0x7fdd2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.955+0000 7fdd3d7fa640 1 -- 172.21.15.106:0/3804965221 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdd380ad620 con 0x7fdd401cf590 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.955+0000 7fdd44a24640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdd2c06c8f0 0x7fdd2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.955+0000 7fdd44a24640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdd2c06c8f0 0x7fdd2c06edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009b40 tx=0x7fdd30009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:33.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:33.959+0000 7fdd3d7fa640 1 -- 172.21.15.106:0/3804965221 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd38033030 con 0x7fdd401cf590 2024-04-16T12:57:34.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.135+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd400b5500 con 0x7fdd401cf590 2024-04-16T12:57:34.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.135+0000 7fdd3d7fa640 1 -- 172.21.15.106:0/3804965221 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fdd3807b570 con 0x7fdd401cf590 2024-04-16T12:57:34.137 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdd2c06c8f0 msgr2=0x7fdd2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdd2c06c8f0 0x7fdd2c06edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009b40 tx=0x7fdd30009190 comp rx=0 tx=0).stop 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd401cf590 msgr2=0x7fdd401debd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd401cf590 0x7fdd401debd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd38001f40 tx=0x7fdd380014a0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 shutdown_connections 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdd2c06c8f0 0x7fdd2c06edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd401cf590 0x7fdd401debd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd401cf130 0x7fdd401de690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 --2- 172.21.15.106:0/3804965221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd280052e0 0x7fdd400b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 >> 172.21.15.106:0/3804965221 conn(0x7fdd400ba4d0 msgr2=0x7fdd400ba8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:34.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.137+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 shutdown_connections 2024-04-16T12:57:34.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.138+0000 7fdd46c88640 1 -- 172.21.15.106:0/3804965221 wait complete. 2024-04-16T12:57:34.150 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:34.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.255+0000 7f61fed1c640 1 Processor -- start 2024-04-16T12:57:34.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.255+0000 7f61fed1c640 1 -- start start 2024-04-16T12:57:34.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fed1c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f61f80b3f70 0x7f61f80b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fed1c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f813e8c0 0x7f61f813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fed1c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f80b4350 con 0x7f61f80b2410 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fed1c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f61f80b3140 con 0x7f61f80b3f70 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fed1c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61f80b3420 con 0x7f61f813e8c0 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fd2b9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f813e8c0 0x7f61f813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fcab8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f61f80b3f70 0x7f61f80b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fd2b9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f813e8c0 0x7f61f813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:47858/0 (socket says 172.21.15.106:47858) 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3466582675 learned_addr learned my addr 172.21.15.106:0/3466582675 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61effff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f61f80b2410 0x7f61f80735f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:45286/0 (socket says 172.21.15.106:45286) 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61ef7fe640 1 -- 172.21.15.106:0/3466582675 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515967520 0 0) 0x7f61f80b4350 con 0x7f61f80b2410 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61ef7fe640 1 -- 172.21.15.106:0/3466582675 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61e0003520 con 0x7f61f80b2410 2024-04-16T12:57:34.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3466582675 >> v2:172.21.15.171:3300/0 conn(0x7f61f80b3f70 msgr2=0x7f61f80b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:34.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fd2b9640 1 --2- 172.21.15.106:0/3466582675 >> v2:172.21.15.171:3300/0 conn(0x7f61f80b3f70 0x7f61f80b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3466582675 >> v1:172.21.15.171:6789/0 conn(0x7f61f80b2410 legacy=0x7f61f80735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3466582675 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f80b2bf0 con 0x7f61f813e8c0 2024-04-16T12:57:34.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.256+0000 7f61fcab8640 1 --2- 172.21.15.106:0/3466582675 >> v2:172.21.15.171:3300/0 conn(0x7f61f80b3f70 0x7f61f80b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:34.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.257+0000 7f61fd2b9640 1 --2- 172.21.15.106:0/3466582675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f813e8c0 0x7f61f813ed10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f61f000d150 tx=0x7f61f002e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85a2024988029a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.257+0000 7f61ef7fe640 1 -- 172.21.15.106:0/3466582675 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f000b0d0 con 0x7f61f813e8c0 2024-04-16T12:57:34.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.257+0000 7f61ef7fe640 1 -- 172.21.15.106:0/3466582675 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f000b270 con 0x7f61f813e8c0 2024-04-16T12:57:34.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.257+0000 7f61ef7fe640 1 -- 172.21.15.106:0/3466582675 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0009600 con 0x7f61f813e8c0 2024-04-16T12:57:34.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 -- 172.21.15.106:0/3466582675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f813e8c0 msgr2=0x7f61f813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3466582675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f813e8c0 0x7f61f813ed10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f61f000d150 tx=0x7f61f002e160 comp rx=0 tx=0).stop 2024-04-16T12:57:34.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 -- 172.21.15.106:0/3466582675 shutdown_connections 2024-04-16T12:57:34.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3466582675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f813e8c0 0x7f61f813ed10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3466582675 >> v2:172.21.15.171:3300/0 conn(0x7f61f80b3f70 0x7f61f80b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 -- 172.21.15.106:0/3466582675 >> 172.21.15.106:0/3466582675 conn(0x7f61f806c510 msgr2=0x7f61f80b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:34.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 -- 172.21.15.106:0/3466582675 shutdown_connections 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.258+0000 7f61fed1c640 1 -- 172.21.15.106:0/3466582675 wait complete. 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 Processor -- start 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 -- start start 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f80b2410 0x7f61f81cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61f80b3f70 0x7f61f81caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f813e8c0 0x7f61f80b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f61f8073e80 con 0x7f61f813e8c0 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f61f8073d00 con 0x7f61f80b3f70 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.259+0000 7f61fed1c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61f80b4590 con 0x7f61f80b2410 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f813e8c0 0x7f61f80b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f813e8c0 0x7f61f80b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33032/0 (socket says 172.21.15.106:33032) 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3752591560 learned_addr learned my addr 172.21.15.106:0/3752591560 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fcab8640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f80b2410 0x7f61f81cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61effff640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61f80b3f70 0x7f61f81caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f80b2410 msgr2=0x7f61f81cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f80b2410 0x7f61f81cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61f80b3f70 msgr2=0x7f61f81caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61f80b3f70 0x7f61f81caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 -- 172.21.15.106:0/3752591560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f81cd510 con 0x7f61f813e8c0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61effff640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61f80b3f70 0x7f61f81caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fd2b9640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f813e8c0 0x7f61f80b7100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61f000d270 tx=0x7f61f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61ed7fa640 1 -- 172.21.15.106:0/3752591560 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0046020 con 0x7f61f813e8c0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61ed7fa640 1 -- 172.21.15.106:0/3752591560 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0042680 con 0x7f61f813e8c0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f8142260 con 0x7f61f813e8c0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61ed7fa640 1 -- 172.21.15.106:0/3752591560 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f000b720 con 0x7f61f813e8c0 2024-04-16T12:57:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.260+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f81cd230 con 0x7f61f813e8c0 2024-04-16T12:57:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.261+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f813e120 con 0x7f61f813e8c0 2024-04-16T12:57:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.262+0000 7f61ed7fa640 1 -- 172.21.15.106:0/3752591560 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61f0049020 con 0x7f61f813e8c0 2024-04-16T12:57:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.262+0000 7f61ed7fa640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.262+0000 7f61fcab8640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.263+0000 7f61ed7fa640 1 -- 172.21.15.106:0/3752591560 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f61f00b07e0 con 0x7f61f813e8c0 2024-04-16T12:57:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.263+0000 7f61fcab8640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f61e406c8f0 0x7f61e406edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61f81cdbc0 tx=0x7f61f4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.267+0000 7f61ed7fa640 1 -- 172.21.15.106:0/3752591560 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61f0050030 con 0x7f61f813e8c0 2024-04-16T12:57:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.441+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f61f8068a90 con 0x7f61f813e8c0 2024-04-16T12:57:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.442+0000 7f61ed7fa640 1 -- 172.21.15.106:0/3752591560 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f61f007edc0 con 0x7f61f813e8c0 2024-04-16T12:57:34.444 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f61e406c8f0 msgr2=0x7f61e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f61e406c8f0 0x7f61e406edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61f81cdbc0 tx=0x7f61f4009190 comp rx=0 tx=0).stop 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f813e8c0 msgr2=0x7f61f80b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f813e8c0 0x7f61f80b7100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61f000d270 tx=0x7f61f0004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 shutdown_connections 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f61e406c8f0 0x7f61e406edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f813e8c0 0x7f61f80b7100 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61f80b3f70 0x7f61f81caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 --2- 172.21.15.106:0/3752591560 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61f80b2410 0x7f61f81cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 >> 172.21.15.106:0/3752591560 conn(0x7f61f806c510 msgr2=0x7f61f80b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 shutdown_connections 2024-04-16T12:57:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.444+0000 7f61fed1c640 1 -- 172.21.15.106:0/3752591560 wait complete. 2024-04-16T12:57:34.456 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:34.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.560+0000 7fd7591af640 1 Processor -- start 2024-04-16T12:57:34.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.561+0000 7fd7591af640 1 -- start start 2024-04-16T12:57:34.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.561+0000 7fd7591af640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd7540b78a0 0x7fd75406dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.561+0000 7fd7591af640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7540b7c80 con 0x7fd75406e520 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.561+0000 7fd7591af640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7540b6f80 con 0x7fd7540b6100 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.561+0000 7fd7591af640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd7540b1d80 con 0x7fd7540b78a0 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.561+0000 7fd75259c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd75406e520 0x7fd754141a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59396/0 (socket says 172.21.15.106:59396) 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.561+0000 7fd75259c640 1 -- 172.21.15.106:0/2911281931 learned_addr learned my addr 172.21.15.106:0/2911281931 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.562+0000 7fd752d9d640 1 --2- 172.21.15.106:0/2911281931 >> v2:172.21.15.171:3300/0 conn(0x7fd7540b78a0 0x7fd75406dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.562+0000 7fd751d9b640 1 -- 172.21.15.106:0/2911281931 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300378639 0 0) 0x7fd7540b7c80 con 0x7fd75406e520 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.562+0000 7fd751d9b640 1 -- 172.21.15.106:0/2911281931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd740003520 con 0x7fd75406e520 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.562+0000 7fd751d9b640 1 -- 172.21.15.106:0/2911281931 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473360428 0 0) 0x7fd740003520 con 0x7fd75406e520 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.562+0000 7fd752d9d640 1 -- 172.21.15.106:0/2911281931 >> v1:172.21.15.171:6789/0 conn(0x7fd7540b6100 legacy=0x7fd7541525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.562+0000 7fd752d9d640 1 -- 172.21.15.106:0/2911281931 >> v1:172.21.15.106:6789/0 conn(0x7fd75406e520 legacy=0x7fd754141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.562+0000 7fd752d9d640 1 -- 172.21.15.106:0/2911281931 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7540b22a0 con 0x7fd7540b78a0 2024-04-16T12:57:34.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd752d9d640 1 --2- 172.21.15.106:0/2911281931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7540b78a0 0x7fd75406dfe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0097a0 tx=0x7fd73c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be7101456053bf20 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd751d9b640 1 -- 172.21.15.106:0/2911281931 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c037070 con 0x7fd7540b78a0 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd751d9b640 1 -- 172.21.15.106:0/2911281931 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c030510 con 0x7fd7540b78a0 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd751d9b640 1 -- 172.21.15.106:0/2911281931 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744001670 con 0x7fd7540b78a0 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd7591af640 1 -- 172.21.15.106:0/2911281931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7540b78a0 msgr2=0x7fd75406dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd7591af640 1 --2- 172.21.15.106:0/2911281931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7540b78a0 0x7fd75406dfe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0097a0 tx=0x7fd73c02b710 comp rx=0 tx=0).stop 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd7591af640 1 -- 172.21.15.106:0/2911281931 shutdown_connections 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd7591af640 1 --2- 172.21.15.106:0/2911281931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7540b78a0 0x7fd75406dfe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd7591af640 1 -- 172.21.15.106:0/2911281931 >> 172.21.15.106:0/2911281931 conn(0x7fd7540b7e90 msgr2=0x7fd7540b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd7591af640 1 -- 172.21.15.106:0/2911281931 shutdown_connections 2024-04-16T12:57:34.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.563+0000 7fd7591af640 1 -- 172.21.15.106:0/2911281931 wait complete. 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 Processor -- start 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 -- start start 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75406e520 0x7fd7540ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7540b6100 0x7fd7541dd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7540b78a0 0x7fd7541ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd7540b5f10 con 0x7fd7540b78a0 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7540b5d90 con 0x7fd75406e520 2024-04-16T12:57:34.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd7591af640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7541421a0 con 0x7fd7540b6100 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd75359e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7540b78a0 0x7fd7541ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd75359e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7540b78a0 0x7fd7541ddbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33042/0 (socket says 172.21.15.106:33042) 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.565+0000 7fd75359e640 1 -- 172.21.15.106:0/4118401784 learned_addr learned my addr 172.21.15.106:0/4118401784 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd752d9d640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75406e520 0x7fd7540ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd75259c640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7540b6100 0x7fd7541dd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd75359e640 1 -- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7540b6100 msgr2=0x7fd7541dd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd75359e640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7540b6100 0x7fd7541dd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd75359e640 1 -- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75406e520 msgr2=0x7fd7540ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd75359e640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75406e520 0x7fd7540ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd75359e640 1 -- 172.21.15.106:0/4118401784 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7540bba00 con 0x7fd7540b78a0 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd75359e640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7540b78a0 0x7fd7541ddbe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00c7a0 tx=0x7fd74c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd74b7fe640 1 -- 172.21.15.106:0/4118401784 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c003b70 con 0x7fd7540b78a0 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd74b7fe640 1 -- 172.21.15.106:0/4118401784 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74c003d30 con 0x7fd7540b78a0 2024-04-16T12:57:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75413b7c0 con 0x7fd7540b78a0 2024-04-16T12:57:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd74b7fe640 1 -- 172.21.15.106:0/4118401784 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00aa90 con 0x7fd7540b78a0 2024-04-16T12:57:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.566+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7540baba0 con 0x7fd7540b78a0 2024-04-16T12:57:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.567+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75406c210 con 0x7fd7540b78a0 2024-04-16T12:57:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.568+0000 7fd74b7fe640 1 -- 172.21.15.106:0/4118401784 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd74c00ac30 con 0x7fd7540b78a0 2024-04-16T12:57:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.568+0000 7fd74b7fe640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd73406c8f0 0x7fd73406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.568+0000 7fd74b7fe640 1 -- 172.21.15.106:0/4118401784 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd74c08b9d0 con 0x7fd7540b78a0 2024-04-16T12:57:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.568+0000 7fd752d9d640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd73406c8f0 0x7fd73406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.569+0000 7fd752d9d640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd73406c8f0 0x7fd73406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd73c034000 tx=0x7fd73c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.573+0000 7fd74b7fe640 1 -- 172.21.15.106:0/4118401784 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7540bba00 con 0x7fd7540b78a0 2024-04-16T12:57:34.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.746+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd7541489a0 con 0x7fd7540b78a0 2024-04-16T12:57:34.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.746+0000 7fd74b7fe640 1 -- 172.21.15.106:0/4118401784 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd74c059e10 con 0x7fd7540b78a0 2024-04-16T12:57:34.748 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:34.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd73406c8f0 msgr2=0x7fd73406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd73406c8f0 0x7fd73406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd73c034000 tx=0x7fd73c008030 comp rx=0 tx=0).stop 2024-04-16T12:57:34.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7540b78a0 msgr2=0x7fd7541ddbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7540b78a0 0x7fd7541ddbe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00c7a0 tx=0x7fd74c00cc60 comp rx=0 tx=0).stop 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 shutdown_connections 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd73406c8f0 0x7fd73406edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7540b78a0 0x7fd7541ddbe0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7540b6100 0x7fd7541dd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 --2- 172.21.15.106:0/4118401784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd75406e520 0x7fd7540ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 >> 172.21.15.106:0/4118401784 conn(0x7fd7540b7e90 msgr2=0x7fd754073210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.748+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 shutdown_connections 2024-04-16T12:57:34.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.749+0000 7fd7591af640 1 -- 172.21.15.106:0/4118401784 wait complete. 2024-04-16T12:57:34.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:34.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.863+0000 7f32fd774640 1 Processor -- start 2024-04-16T12:57:34.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.863+0000 7f32fd774640 1 -- start start 2024-04-16T12:57:34.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32fd774640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f32f80b63a0 0x7f32f80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32fd774640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f32f81481c0 0x7f32f81418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32fd774640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f8148670 0x7f32f8141de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32fd774640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f32f8148b70 con 0x7f32f81481c0 2024-04-16T12:57:34.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32fd774640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f32f80b4bd0 con 0x7f32f80b63a0 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32fd774640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32f80b4eb0 con 0x7f32f8148670 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f32f81481c0 0x7f32f81418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f32f81481c0 0x7f32f81418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33052/0 (socket says 172.21.15.106:33052) 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 -- 172.21.15.106:0/2100637071 learned_addr learned my addr 172.21.15.106:0/2100637071 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32f6ffd640 1 --2- 172.21.15.106:0/2100637071 >> v2:172.21.15.171:3300/0 conn(0x7f32f80b63a0 0x7f32f80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32f77fe640 1 --2- 172.21.15.106:0/2100637071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f8148670 0x7f32f8141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 -- 172.21.15.106:0/2100637071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f8148670 msgr2=0x7f32f8141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:34.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 --2- 172.21.15.106:0/2100637071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f8148670 0x7f32f8141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 -- 172.21.15.106:0/2100637071 >> v2:172.21.15.171:3300/0 conn(0x7f32f80b63a0 msgr2=0x7f32f80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 --2- 172.21.15.106:0/2100637071 >> v2:172.21.15.171:3300/0 conn(0x7f32f80b63a0 0x7f32f80b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.864+0000 7f32ee7fc640 1 -- 172.21.15.106:0/2100637071 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f80b53d0 con 0x7f32f81481c0 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.865+0000 7f32ee7fc640 1 --2- 172.21.15.106:0/2100637071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f81418a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f32f80b9e70 tx=0x7f32e002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dff54c83432306a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.865+0000 7f32f67fc640 1 -- 172.21.15.106:0/2100637071 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e002e070 con 0x7f32f81481c0 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.865+0000 7f32f67fc640 1 -- 172.21.15.106:0/2100637071 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e0037070 con 0x7f32f81481c0 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.865+0000 7f32f67fc640 1 -- 172.21.15.106:0/2100637071 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0031a00 con 0x7f32f81481c0 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 -- 172.21.15.106:0/2100637071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 msgr2=0x7f32f81418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 --2- 172.21.15.106:0/2100637071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f81418a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f32f80b9e70 tx=0x7f32e002b880 comp rx=0 tx=0).stop 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 -- 172.21.15.106:0/2100637071 shutdown_connections 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 --2- 172.21.15.106:0/2100637071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f8148670 0x7f32f8141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 --2- 172.21.15.106:0/2100637071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f81418a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 --2- 172.21.15.106:0/2100637071 >> v2:172.21.15.171:3300/0 conn(0x7f32f80b63a0 0x7f32f80b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 -- 172.21.15.106:0/2100637071 >> 172.21.15.106:0/2100637071 conn(0x7f32f8068080 msgr2=0x7f32f80bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:34.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 -- 172.21.15.106:0/2100637071 shutdown_connections 2024-04-16T12:57:34.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.866+0000 7f32fd774640 1 -- 172.21.15.106:0/2100637071 wait complete. 2024-04-16T12:57:34.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 Processor -- start 2024-04-16T12:57:34.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 -- start start 2024-04-16T12:57:34.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f80b63a0 0x7f32f8142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f8144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32f8148670 0x7f32f8145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f32f80b5ac0 con 0x7f32f81481c0 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32f80b5940 con 0x7f32f8148670 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32fd774640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32f80b5c40 con 0x7f32f80b63a0 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.867+0000 7f32ee7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f8144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f8144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33058/0 (socket says 172.21.15.106:33058) 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 -- 172.21.15.106:0/1247623411 learned_addr learned my addr 172.21.15.106:0/1247623411 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32f6ffd640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f80b63a0 0x7f32f8142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32f77fe640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32f8148670 0x7f32f8145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 -- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f80b63a0 msgr2=0x7f32f8142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f80b63a0 0x7f32f8142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 -- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32f8148670 msgr2=0x7f32f8145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32f8148670 0x7f32f8145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 -- 172.21.15.106:0/1247623411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f8144ab0 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32ee7fc640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f8144ed0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000c00 tx=0x7f32e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32effff640 1 -- 172.21.15.106:0/1247623411 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0032670 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32effff640 1 -- 172.21.15.106:0/1247623411 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e0032810 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f81438f0 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32effff640 1 -- 172.21.15.106:0/1247623411 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0032c00 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.868+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f813e3e0 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.869+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f8068a90 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.870+0000 7f32effff640 1 -- 172.21.15.106:0/1247623411 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32e004c060 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.870+0000 7f32effff640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32d806c8f0 0x7f32d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.870+0000 7f32effff640 1 -- 172.21.15.106:0/1247623411 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f32e00ad2f0 con 0x7f32f81481c0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.870+0000 7f32f6ffd640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32d806c8f0 0x7f32d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.870+0000 7f32f6ffd640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32d806c8f0 0x7f32d806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32f81412c0 tx=0x7f32e8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:34.874+0000 7f32effff640 1 -- 172.21.15.106:0/1247623411 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f32e0040070 con 0x7f32f81481c0 2024-04-16T12:57:35.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.055+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32f813b290 con 0x7f32f81481c0 2024-04-16T12:57:35.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.056+0000 7f32effff640 1 -- 172.21.15.106:0/1247623411 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f32e007b190 con 0x7f32f81481c0 2024-04-16T12:57:35.058 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:35.058 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32d806c8f0 msgr2=0x7f32d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32d806c8f0 0x7f32d806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32f81412c0 tx=0x7f32e8009190 comp rx=0 tx=0).stop 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 msgr2=0x7f32f8144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f8144ed0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000c00 tx=0x7f32e00046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 shutdown_connections 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f32d806c8f0 0x7f32d806edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32f8148670 0x7f32f8145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32f81481c0 0x7f32f8144ed0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 --2- 172.21.15.106:0/1247623411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32f80b63a0 0x7f32f8142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 >> 172.21.15.106:0/1247623411 conn(0x7f32f8068080 msgr2=0x7f32f80ba7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:35.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 shutdown_connections 2024-04-16T12:57:35.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.058+0000 7f32fd774640 1 -- 172.21.15.106:0/1247623411 wait complete. 2024-04-16T12:57:35.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:35.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:35.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.175+0000 7fb2af996640 1 Processor -- start 2024-04-16T12:57:35.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.175+0000 7fb2af996640 1 -- start start 2024-04-16T12:57:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2af996640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb2a814b6d0 0x7fb2a8148520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2af996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a809f5c0 0x7fb2a8148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2af996640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a814c030 con 0x7fb2a809cb60 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2af996640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a8148090 con 0x7fb2a814b6d0 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2af996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a809d470 con 0x7fb2a809f5c0 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2adf33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a809f5c0 0x7fb2a8148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2ad732640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb2a814b6d0 0x7fb2a8148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2acf31640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb2a809cb60 0x7fb2a809eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:45294/0 (socket says 172.21.15.106:45294) 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2ad732640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb2a814b6d0 0x7fb2a8148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:52452/0 (socket says 172.21.15.106:52452) 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2adf33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a809f5c0 0x7fb2a8148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:47900/0 (socket says 172.21.15.106:47900) 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.176+0000 7fb2acf31640 1 -- 172.21.15.106:0/2650491976 learned_addr learned my addr 172.21.15.106:0/2650491976 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.177+0000 7fb2ad732640 1 -- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a809f5c0 msgr2=0x7fb2a8148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.177+0000 7fb2ad732640 1 --2- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a809f5c0 0x7fb2a8148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.177+0000 7fb2ad732640 1 -- 172.21.15.106:0/2650491976 >> v1:172.21.15.171:6789/0 conn(0x7fb2a809cb60 legacy=0x7fb2a809eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.177+0000 7fb2ad732640 1 -- 172.21.15.106:0/2650491976 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a814c310 con 0x7fb2a814b6d0 2024-04-16T12:57:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.177+0000 7fb2adf33640 1 --2- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a809f5c0 0x7fb2a8148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2ad732640 1 --2- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a814b6d0 0x7fb2a8148520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb298009d90 tx=0x7fb29802bbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bac09c7c8bcec52 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2a7fff640 1 -- 172.21.15.106:0/2650491976 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29802d910 con 0x7fb2a814b6d0 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2a7fff640 1 -- 172.21.15.106:0/2650491976 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29802dab0 con 0x7fb2a814b6d0 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2a7fff640 1 -- 172.21.15.106:0/2650491976 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29802c430 con 0x7fb2a814b6d0 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 -- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a814b6d0 msgr2=0x7fb2a8148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 --2- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a814b6d0 0x7fb2a8148520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb298009d90 tx=0x7fb29802bbd0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 -- 172.21.15.106:0/2650491976 shutdown_connections 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 --2- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a809f5c0 0x7fb2a8148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 --2- 172.21.15.106:0/2650491976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a814b6d0 0x7fb2a8148520 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 -- 172.21.15.106:0/2650491976 >> 172.21.15.106:0/2650491976 conn(0x7fb2a80ba080 msgr2=0x7fb2a80ba490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 -- 172.21.15.106:0/2650491976 shutdown_connections 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.178+0000 7fb2af996640 1 -- 172.21.15.106:0/2650491976 wait complete. 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.179+0000 7fb2af996640 1 Processor -- start 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.179+0000 7fb2af996640 1 -- start start 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2af996640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a809cb60 0x7fb2a80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2af996640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2a809f5c0 0x7fb2a81e1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2af996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a814b6d0 0x7fb2a8144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2af996640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a814bc30 con 0x7fb2a809f5c0 2024-04-16T12:57:35.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2af996640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a814bab0 con 0x7fb2a809cb60 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2af996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a814bdb0 con 0x7fb2a814b6d0 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2a809f5c0 0x7fb2a81e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2a809f5c0 0x7fb2a81e1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33068/0 (socket says 172.21.15.106:33068) 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 -- 172.21.15.106:0/952268714 learned_addr learned my addr 172.21.15.106:0/952268714 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2ad732640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a809cb60 0x7fb2a80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2adf33640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a814b6d0 0x7fb2a8144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 -- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a814b6d0 msgr2=0x7fb2a8144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a814b6d0 0x7fb2a8144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 -- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a809cb60 msgr2=0x7fb2a80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a809cb60 0x7fb2a80b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.180+0000 7fb2acf31640 1 -- 172.21.15.106:0/952268714 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a80b2a30 con 0x7fb2a809f5c0 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.181+0000 7fb2acf31640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2a809f5c0 0x7fb2a81e1780 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c7b0 tx=0x7fb29c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.181+0000 7fb2a5ffb640 1 -- 172.21.15.106:0/952268714 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c018070 con 0x7fb2a809f5c0 2024-04-16T12:57:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.181+0000 7fb2a5ffb640 1 -- 172.21.15.106:0/952268714 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c0072d0 con 0x7fb2a809f5c0 2024-04-16T12:57:35.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.181+0000 7fb2a5ffb640 1 -- 172.21.15.106:0/952268714 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0047e0 con 0x7fb2a809f5c0 2024-04-16T12:57:35.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.181+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a80b1b30 con 0x7fb2a809f5c0 2024-04-16T12:57:35.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.181+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a80a1670 con 0x7fb2a809f5c0 2024-04-16T12:57:35.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.182+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a80b8730 con 0x7fb2a809f5c0 2024-04-16T12:57:35.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.182+0000 7fb2a5ffb640 1 -- 172.21.15.106:0/952268714 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb29c004980 con 0x7fb2a809f5c0 2024-04-16T12:57:35.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.183+0000 7fb2a5ffb640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb29406c8f0 0x7fb29406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.183+0000 7fb2ad732640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb29406c8f0 0x7fb29406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.183+0000 7fb2a5ffb640 1 -- 172.21.15.106:0/952268714 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb29c08af90 con 0x7fb2a809f5c0 2024-04-16T12:57:35.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.183+0000 7fb2ad732640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb29406c8f0 0x7fb29406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb298036000 tx=0x7fb298031000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.187+0000 7fb2a5ffb640 1 -- 172.21.15.106:0/952268714 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2a80b8730 con 0x7fb2a809f5c0 2024-04-16T12:57:35.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.362+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2a8068a90 con 0x7fb2a809f5c0 2024-04-16T12:57:35.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.362+0000 7fb2a5ffb640 1 -- 172.21.15.106:0/952268714 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb29c004c70 con 0x7fb2a809f5c0 2024-04-16T12:57:35.364 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:35.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb29406c8f0 msgr2=0x7fb29406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb29406c8f0 0x7fb29406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb298036000 tx=0x7fb298031000 comp rx=0 tx=0).stop 2024-04-16T12:57:35.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2a809f5c0 msgr2=0x7fb2a81e1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2a809f5c0 0x7fb2a81e1780 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c7b0 tx=0x7fb29c00cc70 comp rx=0 tx=0).stop 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 shutdown_connections 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb29406c8f0 0x7fb29406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2a814b6d0 0x7fb2a8144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2a809f5c0 0x7fb2a81e1780 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 --2- 172.21.15.106:0/952268714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2a809cb60 0x7fb2a80b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 >> 172.21.15.106:0/952268714 conn(0x7fb2a80ba080 msgr2=0x7fb2a80ba460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 shutdown_connections 2024-04-16T12:57:35.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.364+0000 7fb2af996640 1 -- 172.21.15.106:0/952268714 wait complete. 2024-04-16T12:57:35.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:35.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f304a27b640 1 Processor -- start 2024-04-16T12:57:35.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f304a27b640 1 -- start start 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f304a27b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30440b5470 0x7f304406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f304a27b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f304406e570 0x7f30441482e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f304a27b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30440b7c20 con 0x7f3044148820 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f304a27b640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f30440b6380 con 0x7f30440b5470 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f304a27b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f30440b5850 con 0x7f304406e570 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f3043fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30440b5470 0x7f304406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f3048818640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3044148820 0x7f3044072420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59412/0 (socket says 172.21.15.106:59412) 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f3043fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30440b5470 0x7f304406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33070/0 (socket says 172.21.15.106:33070) 2024-04-16T12:57:35.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.481+0000 7f3048818640 1 -- 172.21.15.106:0/2279107854 learned_addr learned my addr 172.21.15.106:0/2279107854 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.482+0000 7f3043fff640 1 -- 172.21.15.106:0/2279107854 >> v2:172.21.15.171:3300/0 conn(0x7f304406e570 msgr2=0x7f30441482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.482+0000 7f3043fff640 1 --2- 172.21.15.106:0/2279107854 >> v2:172.21.15.171:3300/0 conn(0x7f304406e570 0x7f30441482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.482+0000 7f3043fff640 1 -- 172.21.15.106:0/2279107854 >> v1:172.21.15.106:6789/0 conn(0x7f3044148820 legacy=0x7f3044072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.482+0000 7f3043fff640 1 -- 172.21.15.106:0/2279107854 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304406dcb0 con 0x7f30440b5470 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.482+0000 7f3042ffd640 1 -- 172.21.15.106:0/2279107854 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705724996 0 0) 0x7f30440b7c20 con 0x7f3044148820 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.482+0000 7f3043fff640 1 --2- 172.21.15.106:0/2279107854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f304406d5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f30440b7b50 tx=0x7f303402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5816dc4e29593b26 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f3042ffd640 1 -- 172.21.15.106:0/2279107854 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034038070 con 0x7f30440b5470 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f3042ffd640 1 -- 172.21.15.106:0/2279107854 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3034031710 con 0x7f30440b5470 2024-04-16T12:57:35.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f3042ffd640 1 -- 172.21.15.106:0/2279107854 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034031ae0 con 0x7f30440b5470 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 -- 172.21.15.106:0/2279107854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 msgr2=0x7f304406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 --2- 172.21.15.106:0/2279107854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f304406d5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f30440b7b50 tx=0x7f303402b7b0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 -- 172.21.15.106:0/2279107854 shutdown_connections 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 --2- 172.21.15.106:0/2279107854 >> v2:172.21.15.171:3300/0 conn(0x7f304406e570 0x7f30441482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 --2- 172.21.15.106:0/2279107854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f304406d5d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 -- 172.21.15.106:0/2279107854 >> 172.21.15.106:0/2279107854 conn(0x7f30440b7f70 msgr2=0x7f30440b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 -- 172.21.15.106:0/2279107854 shutdown_connections 2024-04-16T12:57:35.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.483+0000 7f304a27b640 1 -- 172.21.15.106:0/2279107854 wait complete. 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.484+0000 7f304a27b640 1 Processor -- start 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.484+0000 7f304a27b640 1 -- start start 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f304a27b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304406e570 0x7f30440b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f304a27b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f30440b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f304a27b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3044148820 0x7f3044144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f304a27b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f304406ea00 con 0x7f30440b5470 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f304a27b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30440b7570 con 0x7f304406e570 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f304a27b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3044148cb0 con 0x7f3044148820 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f30440b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f30440b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33078/0 (socket says 172.21.15.106:33078) 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 -- 172.21.15.106:0/106651547 learned_addr learned my addr 172.21.15.106:0/106651547 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f3043fff640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304406e570 0x7f30440b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f3048818640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3044148820 0x7f3044144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 -- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3044148820 msgr2=0x7f3044144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3044148820 0x7f3044144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 -- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304406e570 msgr2=0x7f30440b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304406e570 0x7f30440b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 -- 172.21.15.106:0/106651547 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30440aeb30 con 0x7f30440b5470 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f3043fff640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304406e570 0x7f30440b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.485+0000 7f30437fe640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f30440b13f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f302c00b4d0 tx=0x7f302c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.486+0000 7f3040ff9640 1 -- 172.21.15.106:0/106651547 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c014070 con 0x7f30440b5470 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.486+0000 7f3040ff9640 1 -- 172.21.15.106:0/106651547 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c010870 con 0x7f30440b5470 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.486+0000 7f3040ff9640 1 -- 172.21.15.106:0/106651547 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c010c60 con 0x7f30440b5470 2024-04-16T12:57:35.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.486+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30440afe40 con 0x7f30440b5470 2024-04-16T12:57:35.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.486+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30440ae840 con 0x7f30440b5470 2024-04-16T12:57:35.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.487+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30440691a0 con 0x7f30440b5470 2024-04-16T12:57:35.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.487+0000 7f3040ff9640 1 -- 172.21.15.106:0/106651547 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f302c017070 con 0x7f30440b5470 2024-04-16T12:57:35.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.488+0000 7f3040ff9640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f302406c8f0 0x7f302406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.488+0000 7f3040ff9640 1 -- 172.21.15.106:0/106651547 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f302c08b810 con 0x7f30440b5470 2024-04-16T12:57:35.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.488+0000 7f3043fff640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f302406c8f0 0x7f302406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.488+0000 7f3043fff640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f302406c8f0 0x7f302406edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3034035000 tx=0x7f3034008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.492+0000 7f3040ff9640 1 -- 172.21.15.106:0/106651547 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f302c059cd0 con 0x7f30440b5470 2024-04-16T12:57:35.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.665+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f30441ceab0 con 0x7f30440b5470 2024-04-16T12:57:35.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.666+0000 7f3040ff9640 1 -- 172.21.15.106:0/106651547 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f302c0595d0 con 0x7f30440b5470 2024-04-16T12:57:35.667 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:35.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f302406c8f0 msgr2=0x7f302406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f302406c8f0 0x7f302406edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3034035000 tx=0x7f3034008030 comp rx=0 tx=0).stop 2024-04-16T12:57:35.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 msgr2=0x7f30440b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f30440b13f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f302c00b4d0 tx=0x7f302c00b990 comp rx=0 tx=0).stop 2024-04-16T12:57:35.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 shutdown_connections 2024-04-16T12:57:35.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f302406c8f0 0x7f302406edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3044148820 0x7f3044144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30440b5470 0x7f30440b13f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 --2- 172.21.15.106:0/106651547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304406e570 0x7f30440b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.667+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 >> 172.21.15.106:0/106651547 conn(0x7f30440b7f70 msgr2=0x7f3044146b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:35.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.668+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 shutdown_connections 2024-04-16T12:57:35.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.668+0000 7f304a27b640 1 -- 172.21.15.106:0/106651547 wait complete. 2024-04-16T12:57:35.680 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:35.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.785+0000 7f10e8a55640 1 Processor -- start 2024-04-16T12:57:35.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.785+0000 7f10e8a55640 1 -- start start 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e8a55640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10e40b6570 0x7f10e4148040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e8a55640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e413e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e8a55640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f10e413ebd0 0x7f10e40b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e8a55640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f10e40b6950 con 0x7f10e40b6570 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e8a55640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f10e4148aa0 con 0x7f10e413ebd0 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e8a55640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f10e4148d80 con 0x7f10e4148580 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10e40b6570 0x7f10e4148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10e40b6570 0x7f10e4148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33090/0 (socket says 172.21.15.106:33090) 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 -- 172.21.15.106:0/388919771 learned_addr learned my addr 172.21.15.106:0/388919771 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e1d9b640 1 --2- 172.21.15.106:0/388919771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e413e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e2d9d640 1 --2- 172.21.15.106:0/388919771 >> v2:172.21.15.171:3300/0 conn(0x7f10e413ebd0 0x7f10e40b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 -- 172.21.15.106:0/388919771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 msgr2=0x7f10e413e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 --2- 172.21.15.106:0/388919771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e413e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 -- 172.21.15.106:0/388919771 >> v2:172.21.15.171:3300/0 conn(0x7f10e413ebd0 msgr2=0x7f10e40b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 --2- 172.21.15.106:0/388919771 >> v2:172.21.15.171:3300/0 conn(0x7f10e413ebd0 0x7f10e40b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e259c640 1 -- 172.21.15.106:0/388919771 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e40b0ee0 con 0x7f10e40b6570 2024-04-16T12:57:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.786+0000 7f10e2d9d640 1 --2- 172.21.15.106:0/388919771 >> v2:172.21.15.171:3300/0 conn(0x7f10e413ebd0 0x7f10e40b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:35.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.787+0000 7f10e259c640 1 --2- 172.21.15.106:0/388919771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e40b6570 0x7f10e4148040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f10e406e920 tx=0x7f10d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf0bc6343fdbd93 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.787+0000 7f10e159a640 1 -- 172.21.15.106:0/388919771 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d402e070 con 0x7f10e40b6570 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.787+0000 7f10e159a640 1 -- 172.21.15.106:0/388919771 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d4037070 con 0x7f10e40b6570 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.787+0000 7f10e159a640 1 -- 172.21.15.106:0/388919771 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d4031a00 con 0x7f10e40b6570 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 -- 172.21.15.106:0/388919771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e40b6570 msgr2=0x7f10e4148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 --2- 172.21.15.106:0/388919771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e40b6570 0x7f10e4148040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f10e406e920 tx=0x7f10d402b880 comp rx=0 tx=0).stop 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 -- 172.21.15.106:0/388919771 shutdown_connections 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 --2- 172.21.15.106:0/388919771 >> v2:172.21.15.171:3300/0 conn(0x7f10e413ebd0 0x7f10e40b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 --2- 172.21.15.106:0/388919771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e413e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 --2- 172.21.15.106:0/388919771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e40b6570 0x7f10e4148040 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 -- 172.21.15.106:0/388919771 >> 172.21.15.106:0/388919771 conn(0x7f10e40bd690 msgr2=0x7f10e40bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 -- 172.21.15.106:0/388919771 shutdown_connections 2024-04-16T12:57:35.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.788+0000 7f10e8a55640 1 -- 172.21.15.106:0/388919771 wait complete. 2024-04-16T12:57:35.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.789+0000 7f10e8a55640 1 Processor -- start 2024-04-16T12:57:35.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.789+0000 7f10e8a55640 1 -- start start 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10e40b6570 0x7f10e41433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e413ebd0 0x7f10e41dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e41de350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f10e40b5740 con 0x7f10e413ebd0 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f10e40b55c0 con 0x7f10e40b6570 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f10e414b630 con 0x7f10e4148580 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e413ebd0 0x7f10e41dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e413ebd0 0x7f10e41dde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33104/0 (socket says 172.21.15.106:33104) 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 -- 172.21.15.106:0/2927584785 learned_addr learned my addr 172.21.15.106:0/2927584785 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e259c640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10e40b6570 0x7f10e41433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e2d9d640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e41de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 -- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 msgr2=0x7f10e41de350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e41de350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 -- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10e40b6570 msgr2=0x7f10e41433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10e40b6570 0x7f10e41433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 -- 172.21.15.106:0/2927584785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e41457e0 con 0x7f10e413ebd0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e1d9b640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e413ebd0 0x7f10e41dde10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c5c0 tx=0x7f10d800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10d2ffd640 1 -- 172.21.15.106:0/2927584785 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8015070 con 0x7f10e413ebd0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10d2ffd640 1 -- 172.21.15.106:0/2927584785 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8004220 con 0x7f10e413ebd0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e41452b0 con 0x7f10e413ebd0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10d2ffd640 1 -- 172.21.15.106:0/2927584785 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8003610 con 0x7f10e413ebd0 2024-04-16T12:57:35.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.790+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e4140fe0 con 0x7f10e413ebd0 2024-04-16T12:57:35.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.791+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e4068a90 con 0x7f10e413ebd0 2024-04-16T12:57:35.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.792+0000 7f10d2ffd640 1 -- 172.21.15.106:0/2927584785 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10d80037b0 con 0x7f10e413ebd0 2024-04-16T12:57:35.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.792+0000 7f10d2ffd640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:35.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.792+0000 7f10d2ffd640 1 -- 172.21.15.106:0/2927584785 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f10d808bad0 con 0x7f10e413ebd0 2024-04-16T12:57:35.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.792+0000 7f10e259c640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:35.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.793+0000 7f10e259c640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f10c406c8f0 0x7f10c406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f10d4036000 tx=0x7f10d403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:35.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.797+0000 7f10d2ffd640 1 -- 172.21.15.106:0/2927584785 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10d8059940 con 0x7f10e413ebd0 2024-04-16T12:57:35.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.972+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f10e414b410 con 0x7f10e413ebd0 2024-04-16T12:57:35.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.972+0000 7f10d2ffd640 1 -- 172.21.15.106:0/2927584785 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f10d805dc40 con 0x7f10e413ebd0 2024-04-16T12:57:35.974 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:35.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f10c406c8f0 msgr2=0x7f10c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f10c406c8f0 0x7f10c406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f10d4036000 tx=0x7f10d403d040 comp rx=0 tx=0).stop 2024-04-16T12:57:35.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e413ebd0 msgr2=0x7f10e41dde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:35.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e413ebd0 0x7f10e41dde10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c5c0 tx=0x7f10d800ca80 comp rx=0 tx=0).stop 2024-04-16T12:57:35.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 shutdown_connections 2024-04-16T12:57:35.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10e4148580 0x7f10e41de350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10e413ebd0 0x7f10e41dde10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 --2- 172.21.15.106:0/2927584785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10e40b6570 0x7f10e41433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:35.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 >> 172.21.15.106:0/2927584785 conn(0x7f10e40bd690 msgr2=0x7f10e40bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:35.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 shutdown_connections 2024-04-16T12:57:35.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:35.974+0000 7f10e8a55640 1 -- 172.21.15.106:0/2927584785 wait complete. 2024-04-16T12:57:35.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:36.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.088+0000 7fb359ad9640 1 Processor -- start 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.088+0000 7fb359ad9640 1 -- start start 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb359ad9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb3540b4670 0x7fb35413f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb359ad9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540b18f0 0x7fb35413fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb359ad9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3540bb150 con 0x7fb3540bad70 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb359ad9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb354149770 con 0x7fb3540b4670 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb359ad9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3540b3100 con 0x7fb3540b18f0 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb3537fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb3540bad70 0x7fb354149060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59422/0 (socket says 172.21.15.106:59422) 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb3537fe640 1 -- 172.21.15.106:0/4264602870 learned_addr learned my addr 172.21.15.106:0/4264602870 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:36.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb34affd640 1 --2- 172.21.15.106:0/4264602870 >> v2:172.21.15.171:3300/0 conn(0x7fb3540b4670 0x7fb35413f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb353fff640 1 --2- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540b18f0 0x7fb35413fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb352ffd640 1 -- 172.21.15.106:0/4264602870 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380194537 0 0) 0x7fb3540bb150 con 0x7fb3540bad70 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.089+0000 7fb352ffd640 1 -- 172.21.15.106:0/4264602870 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb340003520 con 0x7fb3540bad70 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.090+0000 7fb352ffd640 1 -- 172.21.15.106:0/4264602870 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 550860824 0 0) 0x7fb340003520 con 0x7fb3540bad70 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.090+0000 7fb34affd640 1 -- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540b18f0 msgr2=0x7fb35413fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.090+0000 7fb34affd640 1 --2- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540b18f0 0x7fb35413fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.090+0000 7fb34affd640 1 -- 172.21.15.106:0/4264602870 >> v1:172.21.15.106:6789/0 conn(0x7fb3540bad70 legacy=0x7fb354149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.090+0000 7fb34affd640 1 -- 172.21.15.106:0/4264602870 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3540b3330 con 0x7fb3540b4670 2024-04-16T12:57:36.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb34affd640 1 --2- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b4670 0x7fb35413f790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0097a0 tx=0x7fb33c02b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9cbc75f9c041b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb352ffd640 1 -- 172.21.15.106:0/4264602870 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c037070 con 0x7fb3540b4670 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb352ffd640 1 -- 172.21.15.106:0/4264602870 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c030510 con 0x7fb3540b4670 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb352ffd640 1 -- 172.21.15.106:0/4264602870 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c02be60 con 0x7fb3540b4670 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 -- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b4670 msgr2=0x7fb35413f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 --2- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b4670 0x7fb35413f790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0097a0 tx=0x7fb33c02b660 comp rx=0 tx=0).stop 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 -- 172.21.15.106:0/4264602870 shutdown_connections 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 --2- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540b18f0 0x7fb35413fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 --2- 172.21.15.106:0/4264602870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b4670 0x7fb35413f790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 -- 172.21.15.106:0/4264602870 >> 172.21.15.106:0/4264602870 conn(0x7fb35406d150 msgr2=0x7fb3540ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 -- 172.21.15.106:0/4264602870 shutdown_connections 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.091+0000 7fb359ad9640 1 -- 172.21.15.106:0/4264602870 wait complete. 2024-04-16T12:57:36.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.092+0000 7fb359ad9640 1 Processor -- start 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb359ad9640 1 -- start start 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb359ad9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b18f0 0x7fb3540b7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb359ad9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3540b4670 0x7fb3540b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb359ad9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540bad70 0x7fb354139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb359ad9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb3540b6b80 con 0x7fb3540b4670 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb359ad9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb3540b6a00 con 0x7fb3540b18f0 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb359ad9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3540b3b30 con 0x7fb3540bad70 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3540b4670 0x7fb3540b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3540b4670 0x7fb3540b9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33114/0 (socket says 172.21.15.106:33114) 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 -- 172.21.15.106:0/3383083092 learned_addr learned my addr 172.21.15.106:0/3383083092 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb353fff640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540bad70 0x7fb354139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb3537fe640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b18f0 0x7fb3540b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 -- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540bad70 msgr2=0x7fb354139690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540bad70 0x7fb354139690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 -- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b18f0 msgr2=0x7fb3540b7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b18f0 0x7fb3540b7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.093+0000 7fb34affd640 1 -- 172.21.15.106:0/3383083092 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3540b9990 con 0x7fb3540b4670 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.094+0000 7fb34affd640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3540b4670 0x7fb3540b9e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000c00 tx=0x7fb33c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.094+0000 7fb350ff9640 1 -- 172.21.15.106:0/3383083092 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c041070 con 0x7fb3540b4670 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.094+0000 7fb350ff9640 1 -- 172.21.15.106:0/3383083092 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c03c870 con 0x7fb3540b4670 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.094+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3541425e0 con 0x7fb3540b4670 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.094+0000 7fb350ff9640 1 -- 172.21.15.106:0/3383083092 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c037040 con 0x7fb3540b4670 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.094+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3541430c0 con 0x7fb3540b4670 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.095+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3540b9b60 con 0x7fb3540b4670 2024-04-16T12:57:36.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.095+0000 7fb350ff9640 1 -- 172.21.15.106:0/3383083092 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb33c044070 con 0x7fb3540b4670 2024-04-16T12:57:36.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.096+0000 7fb350ff9640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb33406c8f0 0x7fb33406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.096+0000 7fb3537fe640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb33406c8f0 0x7fb33406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.096+0000 7fb350ff9640 1 -- 172.21.15.106:0/3383083092 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb33c0ad280 con 0x7fb3540b4670 2024-04-16T12:57:36.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.096+0000 7fb3537fe640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb33406c8f0 0x7fb33406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb344001360 tx=0x7fb3440012b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.100+0000 7fb350ff9640 1 -- 172.21.15.106:0/3383083092 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb33c07b0f0 con 0x7fb3540b4670 2024-04-16T12:57:36.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.278+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3540691a0 con 0x7fb3540b4670 2024-04-16T12:57:36.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.279+0000 7fb350ff9640 1 -- 172.21.15.106:0/3383083092 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fb33c07f3f0 con 0x7fb3540b4670 2024-04-16T12:57:36.281 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:36.281 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb33406c8f0 msgr2=0x7fb33406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb33406c8f0 0x7fb33406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb344001360 tx=0x7fb3440012b0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3540b4670 msgr2=0x7fb3540b9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3540b4670 0x7fb3540b9e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000c00 tx=0x7fb33c0046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 shutdown_connections 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb33406c8f0 0x7fb33406edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3540bad70 0x7fb354139690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3540b4670 0x7fb3540b9e70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 --2- 172.21.15.106:0/3383083092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3540b18f0 0x7fb3540b7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 >> 172.21.15.106:0/3383083092 conn(0x7fb35406d150 msgr2=0x7fb354146eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:36.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 shutdown_connections 2024-04-16T12:57:36.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.281+0000 7fb359ad9640 1 -- 172.21.15.106:0/3383083092 wait complete. 2024-04-16T12:57:36.294 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:36.294 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:36.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.399+0000 7ff2c1ec7640 1 Processor -- start 2024-04-16T12:57:36.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.399+0000 7ff2c1ec7640 1 -- start start 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2c1ec7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff2bc067a30 0x7ff2bc0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2c1ec7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0af200 con 0x7ff2bc06f010 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2c1ec7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc06d830 con 0x7ff2bc06f470 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2c1ec7640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc0b0ba0 con 0x7ff2bc067a30 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2bb7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff2bc067a30 0x7ff2bc0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2b2ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff2bc06f010 0x7ff2bc13f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59436/0 (socket says 172.21.15.106:59436) 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2b2ffd640 1 -- 172.21.15.106:0/149805143 learned_addr learned my addr 172.21.15.106:0/149805143 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2bb7fe640 1 -- 172.21.15.106:0/149805143 >> v1:172.21.15.171:6789/0 conn(0x7ff2bc06f470 legacy=0x7ff2bc1503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2bb7fe640 1 -- 172.21.15.106:0/149805143 >> v1:172.21.15.106:6789/0 conn(0x7ff2bc06f010 legacy=0x7ff2bc13f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2bb7fe640 1 -- 172.21.15.106:0/149805143 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc149050 con 0x7ff2bc067a30 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.400+0000 7ff2baffd640 1 -- 172.21.15.106:0/149805143 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279999764 0 0) 0x7ff2bc0af200 con 0x7ff2bc06f010 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.401+0000 7ff2bb7fe640 1 --2- 172.21.15.106:0/149805143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc067a30 0x7ff2bc0b0660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0097a0 tx=0x7ff2ac02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28adf098c49092a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.401+0000 7ff2baffd640 1 -- 172.21.15.106:0/149805143 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac038070 con 0x7ff2bc067a30 2024-04-16T12:57:36.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.401+0000 7ff2baffd640 1 -- 172.21.15.106:0/149805143 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac031700 con 0x7ff2bc067a30 2024-04-16T12:57:36.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.401+0000 7ff2baffd640 1 -- 172.21.15.106:0/149805143 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac031ad0 con 0x7ff2bc067a30 2024-04-16T12:57:36.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.402+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/149805143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc067a30 msgr2=0x7ff2bc0b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.402+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/149805143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc067a30 0x7ff2bc0b0660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0097a0 tx=0x7ff2ac02b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.402+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/149805143 shutdown_connections 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.402+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/149805143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc067a30 0x7ff2bc0b0660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.402+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/149805143 >> 172.21.15.106:0/149805143 conn(0x7ff2bc06b9b0 msgr2=0x7ff2bc06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.402+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/149805143 shutdown_connections 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.402+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/149805143 wait complete. 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.403+0000 7ff2c1ec7640 1 Processor -- start 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.403+0000 7ff2c1ec7640 1 -- start start 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2bc067a30 0x7ff2bc1480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2bc06f010 0x7ff2bc140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc06f470 0x7ff2bc0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc067e10 con 0x7ff2bc06f470 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1401d0 con 0x7ff2bc067a30 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc0aefb0 con 0x7ff2bc06f010 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc06f470 0x7ff2bc0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc06f470 0x7ff2bc0b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33132/0 (socket says 172.21.15.106:33132) 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 -- 172.21.15.106:0/3360729059 learned_addr learned my addr 172.21.15.106:0/3360729059 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bb7fe640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2bc067a30 0x7ff2bc1480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2b2ffd640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2bc06f010 0x7ff2bc140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 -- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2bc06f010 msgr2=0x7ff2bc140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2bc06f010 0x7ff2bc140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 -- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2bc067a30 msgr2=0x7ff2bc1480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2bc067a30 0x7ff2bc1480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 -- 172.21.15.106:0/3360729059 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc141490 con 0x7ff2bc06f470 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bb7fe640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2bc067a30 0x7ff2bc1480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2bbfff640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc06f470 0x7ff2bc0b25d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b9e0 tx=0x7ff2b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2b8ff9640 1 -- 172.21.15.106:0/3360729059 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4003b70 con 0x7ff2bc06f470 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2b8ff9640 1 -- 172.21.15.106:0/3360729059 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b4003d10 con 0x7ff2bc06f470 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc0b38e0 con 0x7ff2bc06f470 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2b8ff9640 1 -- 172.21.15.106:0/3360729059 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400cb60 con 0x7ff2bc06f470 2024-04-16T12:57:36.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.404+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc148bb0 con 0x7ff2bc06f470 2024-04-16T12:57:36.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.405+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc068a90 con 0x7ff2bc06f470 2024-04-16T12:57:36.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.406+0000 7ff2b8ff9640 1 -- 172.21.15.106:0/3360729059 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2b400cd00 con 0x7ff2bc06f470 2024-04-16T12:57:36.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.406+0000 7ff2b8ff9640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff29c06c8f0 0x7ff29c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.406+0000 7ff2b8ff9640 1 -- 172.21.15.106:0/3360729059 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2b408b8d0 con 0x7ff2bc06f470 2024-04-16T12:57:36.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.406+0000 7ff2bb7fe640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff29c06c8f0 0x7ff29c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.407+0000 7ff2bb7fe640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff29c06c8f0 0x7ff29c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac035000 tx=0x7ff2ac008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.410+0000 7ff2b8ff9640 1 -- 172.21.15.106:0/3360729059 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2bc141490 con 0x7ff2bc06f470 2024-04-16T12:57:36.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.588+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2bc06d160 con 0x7ff2bc06f470 2024-04-16T12:57:36.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.589+0000 7ff2b8ff9640 1 -- 172.21.15.106:0/3360729059 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff2b4059d90 con 0x7ff2bc06f470 2024-04-16T12:57:36.590 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:36.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff29c06c8f0 msgr2=0x7ff29c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff29c06c8f0 0x7ff29c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac035000 tx=0x7ff2ac008030 comp rx=0 tx=0).stop 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc06f470 msgr2=0x7ff2bc0b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc06f470 0x7ff2bc0b25d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b9e0 tx=0x7ff2b400bea0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 shutdown_connections 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff29c06c8f0 0x7ff29c06edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2bc06f470 0x7ff2bc0b25d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2bc06f010 0x7ff2bc140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 --2- 172.21.15.106:0/3360729059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2bc067a30 0x7ff2bc1480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 >> 172.21.15.106:0/3360729059 conn(0x7ff2bc06b9b0 msgr2=0x7ff2bc146240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 shutdown_connections 2024-04-16T12:57:36.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.591+0000 7ff2c1ec7640 1 -- 172.21.15.106:0/3360729059 wait complete. 2024-04-16T12:57:36.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:36.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.707+0000 7f281c469640 1 Processor -- start 2024-04-16T12:57:36.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.707+0000 7f281c469640 1 -- start start 2024-04-16T12:57:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281c469640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140b2c80 0x7f2814073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281c469640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2814073c40 0x7f2814150460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281c469640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28140b3060 con 0x7f28140b4f00 2024-04-16T12:57:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281c469640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f28140709e0 con 0x7f2814073c40 2024-04-16T12:57:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281c469640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2814070fa0 con 0x7f28140b2c80 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281aa06640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2814073c40 0x7f2814150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281a205640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140b2c80 0x7f2814073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281a205640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140b2c80 0x7f2814073700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:47980/0 (socket says 172.21.15.106:47980) 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281aa06640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2814073c40 0x7f2814150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:52548/0 (socket says 172.21.15.106:52548) 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.708+0000 7f281a205640 1 -- 172.21.15.106:0/1587748261 learned_addr learned my addr 172.21.15.106:0/1587748261 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.709+0000 7f281aa06640 1 -- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140b2c80 msgr2=0x7f2814073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.709+0000 7f281aa06640 1 --2- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140b2c80 0x7f2814073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.709+0000 7f281aa06640 1 -- 172.21.15.106:0/1587748261 >> v1:172.21.15.171:6789/0 conn(0x7f28140b4f00 legacy=0x7f281413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.709+0000 7f2819203640 1 -- 172.21.15.106:0/1587748261 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648967213 0 0) 0x7f28140b3060 con 0x7f28140b4f00 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.709+0000 7f281aa06640 1 -- 172.21.15.106:0/1587748261 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2814070c30 con 0x7f2814073c40 2024-04-16T12:57:36.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.709+0000 7f281a205640 1 --2- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140b2c80 0x7f2814073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281aa06640 1 --2- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2814073c40 0x7f2814150460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b3943ad8c30ac69 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f2819203640 1 -- 172.21.15.106:0/1587748261 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0315a0 con 0x7f2814073c40 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f2819203640 1 -- 172.21.15.106:0/1587748261 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c037070 con 0x7f2814073c40 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f2819203640 1 -- 172.21.15.106:0/1587748261 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c031960 con 0x7f2814073c40 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 -- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2814073c40 msgr2=0x7f2814150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 --2- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2814073c40 0x7f2814150460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02b840 comp rx=0 tx=0).stop 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 -- 172.21.15.106:0/1587748261 shutdown_connections 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 --2- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2814073c40 0x7f2814150460 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 --2- 172.21.15.106:0/1587748261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140b2c80 0x7f2814073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 -- 172.21.15.106:0/1587748261 >> 172.21.15.106:0/1587748261 conn(0x7f281406c510 msgr2=0x7f28140b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:36.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 -- 172.21.15.106:0/1587748261 shutdown_connections 2024-04-16T12:57:36.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.710+0000 7f281c469640 1 -- 172.21.15.106:0/1587748261 wait complete. 2024-04-16T12:57:36.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.711+0000 7f281c469640 1 Processor -- start 2024-04-16T12:57:36.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.711+0000 7f281c469640 1 -- start start 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281c469640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2814073c40 0x7f2814142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281c469640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28140b2c80 0x7f28141db510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281c469640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140afc80 0x7f28140b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281c469640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f28140703e0 con 0x7f2814073c40 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281c469640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2814070260 con 0x7f28140b2c80 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281c469640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28140b59a0 con 0x7f28140afc80 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2814073c40 0x7f2814142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2814073c40 0x7f2814142030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33144/0 (socket says 172.21.15.106:33144) 2024-04-16T12:57:36.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 -- 172.21.15.106:0/2547299123 learned_addr learned my addr 172.21.15.106:0/2547299123 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f2819a04640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28140b2c80 0x7f28141db510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281aa06640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140afc80 0x7f28140b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 -- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140afc80 msgr2=0x7f28140b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140afc80 0x7f28140b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 -- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28140b2c80 msgr2=0x7f28141db510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28140b2c80 0x7f28141db510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.712+0000 7f281a205640 1 -- 172.21.15.106:0/2547299123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28140a94d0 con 0x7f2814073c40 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.713+0000 7f281a205640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2814073c40 0x7f2814142030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2804009f20 tx=0x7f280400c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.713+0000 7f2812ffd640 1 -- 172.21.15.106:0/2547299123 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804014480 con 0x7f2814073c40 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.713+0000 7f2812ffd640 1 -- 172.21.15.106:0/2547299123 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2804019070 con 0x7f2814073c40 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.713+0000 7f2812ffd640 1 -- 172.21.15.106:0/2547299123 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804014820 con 0x7f2814073c40 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.713+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28141dbdb0 con 0x7f2814073c40 2024-04-16T12:57:36.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.713+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28141dba50 con 0x7f2814073c40 2024-04-16T12:57:36.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.714+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28141426d0 con 0x7f2814073c40 2024-04-16T12:57:36.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.714+0000 7f2812ffd640 1 -- 172.21.15.106:0/2547299123 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2804005d10 con 0x7f2814073c40 2024-04-16T12:57:36.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.714+0000 7f2812ffd640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f280006c8f0 0x7f280006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:36.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.715+0000 7f2812ffd640 1 -- 172.21.15.106:0/2547299123 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f280408bed0 con 0x7f2814073c40 2024-04-16T12:57:36.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.715+0000 7f2819a04640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f280006c8f0 0x7f280006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:36.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.715+0000 7f2819a04640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f280006c8f0 0x7f280006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f28141d58f0 tx=0x7f2808009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:36.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.719+0000 7f2812ffd640 1 -- 172.21.15.106:0/2547299123 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2804010040 con 0x7f2814073c40 2024-04-16T12:57:36.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.895+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2814068a90 con 0x7f2814073c40 2024-04-16T12:57:36.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.895+0000 7f2812ffd640 1 -- 172.21.15.106:0/2547299123 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f2804059d40 con 0x7f2814073c40 2024-04-16T12:57:36.897 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f280006c8f0 msgr2=0x7f280006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f280006c8f0 0x7f280006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f28141d58f0 tx=0x7f2808009040 comp rx=0 tx=0).stop 2024-04-16T12:57:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2814073c40 msgr2=0x7f2814142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2814073c40 0x7f2814142030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2804009f20 tx=0x7f280400c550 comp rx=0 tx=0).stop 2024-04-16T12:57:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 shutdown_connections 2024-04-16T12:57:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f280006c8f0 0x7f280006edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28140afc80 0x7f28140b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28140b2c80 0x7f28141db510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 --2- 172.21.15.106:0/2547299123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2814073c40 0x7f2814142030 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 >> 172.21.15.106:0/2547299123 conn(0x7f281406c510 msgr2=0x7f281413b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 shutdown_connections 2024-04-16T12:57:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:36.897+0000 7f281c469640 1 -- 172.21.15.106:0/2547299123 wait complete. 2024-04-16T12:57:36.910 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.016+0000 7f42c669a640 1 Processor -- start 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.016+0000 7f42c669a640 1 -- start start 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42c669a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42c00b63e0 0x7f42c00b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42c669a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f42c0142140 0x7f42c01526c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42c669a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c00b67c0 con 0x7f42c01486a0 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42c669a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f42c00b7610 con 0x7f42c00b63e0 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42c669a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f42c00b5660 con 0x7f42c0142140 2024-04-16T12:57:37.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42c00b63e0 0x7f42c00b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bf7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f42c01486a0 0x7f42c0141a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59444/0 (socket says 172.21.15.106:59444) 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bf7fe640 1 -- 172.21.15.106:0/28729438 learned_addr learned my addr 172.21.15.106:0/28729438 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42c00b63e0 0x7f42c00b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33160/0 (socket says 172.21.15.106:33160) 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42c4c37640 1 --2- 172.21.15.106:0/28729438 >> v2:172.21.15.171:3300/0 conn(0x7f42c0142140 0x7f42c01526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bffff640 1 -- 172.21.15.106:0/28729438 >> v2:172.21.15.171:3300/0 conn(0x7f42c0142140 msgr2=0x7f42c01526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bffff640 1 --2- 172.21.15.106:0/28729438 >> v2:172.21.15.171:3300/0 conn(0x7f42c0142140 0x7f42c01526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bffff640 1 -- 172.21.15.106:0/28729438 >> v1:172.21.15.106:6789/0 conn(0x7f42c01486a0 legacy=0x7f42c0141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42bffff640 1 -- 172.21.15.106:0/28729438 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c00b59a0 con 0x7f42c00b63e0 2024-04-16T12:57:37.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.017+0000 7f42beffd640 1 -- 172.21.15.106:0/28729438 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893578458 0 0) 0x7f42c00b67c0 con 0x7f42c01486a0 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.018+0000 7f42bffff640 1 --2- 172.21.15.106:0/28729438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c00b63e0 0x7f42c00b6f00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f42c00b9de0 tx=0x7f42b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5014559f8dee777 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.018+0000 7f42beffd640 1 -- 172.21.15.106:0/28729438 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0035020 con 0x7f42c00b63e0 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.018+0000 7f42beffd640 1 -- 172.21.15.106:0/28729438 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0031830 con 0x7f42c00b63e0 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.018+0000 7f42beffd640 1 -- 172.21.15.106:0/28729438 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0031c00 con 0x7f42c00b63e0 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 -- 172.21.15.106:0/28729438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c00b63e0 msgr2=0x7f42c00b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 --2- 172.21.15.106:0/28729438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c00b63e0 0x7f42c00b6f00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f42c00b9de0 tx=0x7f42b002b8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 -- 172.21.15.106:0/28729438 shutdown_connections 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 --2- 172.21.15.106:0/28729438 >> v2:172.21.15.171:3300/0 conn(0x7f42c0142140 0x7f42c01526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 --2- 172.21.15.106:0/28729438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c00b63e0 0x7f42c00b6f00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 -- 172.21.15.106:0/28729438 >> 172.21.15.106:0/28729438 conn(0x7f42c00bd640 msgr2=0x7f42c00bda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 -- 172.21.15.106:0/28729438 shutdown_connections 2024-04-16T12:57:37.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.019+0000 7f42c669a640 1 -- 172.21.15.106:0/28729438 wait complete. 2024-04-16T12:57:37.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.020+0000 7f42c669a640 1 Processor -- start 2024-04-16T12:57:37.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.020+0000 7f42c669a640 1 -- start start 2024-04-16T12:57:37.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42c669a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42c00b63e0 0x7f42c01445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42c669a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c0142140 0x7f42c01dd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42c669a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42c01486a0 0x7f42c00b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42c669a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00b7fc0 con 0x7f42c0142140 2024-04-16T12:57:37.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42c669a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f42c0148d20 con 0x7f42c00b63e0 2024-04-16T12:57:37.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42c669a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f42c00b8140 con 0x7f42c01486a0 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c0142140 0x7f42c01dd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c0142140 0x7f42c01dd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33162/0 (socket says 172.21.15.106:33162) 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 -- 172.21.15.106:0/3078639098 learned_addr learned my addr 172.21.15.106:0/3078639098 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bffff640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42c00b63e0 0x7f42c01445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42c4c37640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42c01486a0 0x7f42c00b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 -- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42c01486a0 msgr2=0x7f42c00b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42c01486a0 0x7f42c00b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 -- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42c00b63e0 msgr2=0x7f42c01445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42c00b63e0 0x7f42c01445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 -- 172.21.15.106:0/3078639098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c014a680 con 0x7f42c0142140 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bf7fe640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c0142140 0x7f42c01dd400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f42b400c430 tx=0x7f42b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bcff9640 1 -- 172.21.15.106:0/3078639098 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40074e0 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.021+0000 7f42bcff9640 1 -- 172.21.15.106:0/3078639098 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b40047e0 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.022+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c00aaa70 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.022+0000 7f42bcff9640 1 -- 172.21.15.106:0/3078639098 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4004bd0 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.022+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c014a8f0 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.022+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c0068a90 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.023+0000 7f42bcff9640 1 -- 172.21.15.106:0/3078639098 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42b4011070 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.024+0000 7f42bcff9640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42ac06c920 0x7f42ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.024+0000 7f42bcff9640 1 -- 172.21.15.106:0/3078639098 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f42b408bad0 con 0x7f42c0142140 2024-04-16T12:57:37.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.024+0000 7f42bffff640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42ac06c920 0x7f42ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.024+0000 7f42bffff640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42ac06c920 0x7f42ac06ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42b0036000 tx=0x7f42b003d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.028+0000 7f42bcff9640 1 -- 172.21.15.106:0/3078639098 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42b408be20 con 0x7f42c0142140 2024-04-16T12:57:37.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.205+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f42c00aa790 con 0x7f42c0142140 2024-04-16T12:57:37.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.205+0000 7f42bcff9640 1 -- 172.21.15.106:0/3078639098 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f42b4059a20 con 0x7f42c0142140 2024-04-16T12:57:37.207 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42ac06c920 msgr2=0x7f42ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42ac06c920 0x7f42ac06ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42b0036000 tx=0x7f42b003d040 comp rx=0 tx=0).stop 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c0142140 msgr2=0x7f42c01dd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c0142140 0x7f42c01dd400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f42b400c430 tx=0x7f42b400c8f0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 shutdown_connections 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f42ac06c920 0x7f42ac06ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42c01486a0 0x7f42c00b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c0142140 0x7f42c01dd400 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 --2- 172.21.15.106:0/3078639098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42c00b63e0 0x7f42c01445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 >> 172.21.15.106:0/3078639098 conn(0x7f42c00bd640 msgr2=0x7f42c0146d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:37.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 shutdown_connections 2024-04-16T12:57:37.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.207+0000 7f42c669a640 1 -- 172.21.15.106:0/3078639098 wait complete. 2024-04-16T12:57:37.220 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:37.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.321+0000 7f3a9533d640 1 Processor -- start 2024-04-16T12:57:37.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.321+0000 7f3a9533d640 1 -- start start 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a9533d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3a900b63a0 0x7f3a900b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a9533d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a90148670 0x7f3a900b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a9533d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a90148b70 con 0x7f3a901481c0 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a9533d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f3a900b4bd0 con 0x7f3a900b63a0 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a9533d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3a900b4eb0 con 0x7f3a90148670 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3a900b63a0 0x7f3a900b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8e7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3a901481c0 0x7f3a901418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59456/0 (socket says 172.21.15.106:59456) 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3a900b63a0 0x7f3a900b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33178/0 (socket says 172.21.15.106:33178) 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8e7fc640 1 -- 172.21.15.106:0/4252326261 learned_addr learned my addr 172.21.15.106:0/4252326261 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8f7fe640 1 --2- 172.21.15.106:0/4252326261 >> v2:172.21.15.171:3300/0 conn(0x7f3a90148670 0x7f3a900b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8effd640 1 -- 172.21.15.106:0/4252326261 >> v2:172.21.15.171:3300/0 conn(0x7f3a90148670 msgr2=0x7f3a900b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8effd640 1 --2- 172.21.15.106:0/4252326261 >> v2:172.21.15.171:3300/0 conn(0x7f3a90148670 0x7f3a900b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8effd640 1 -- 172.21.15.106:0/4252326261 >> v1:172.21.15.106:6789/0 conn(0x7f3a901481c0 legacy=0x7f3a901418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8effd640 1 -- 172.21.15.106:0/4252326261 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a90141fb0 con 0x7f3a900b63a0 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8dffb640 1 -- 172.21.15.106:0/4252326261 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041257985 0 0) 0x7f3a90148b70 con 0x7f3a901481c0 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.322+0000 7f3a8f7fe640 1 --2- 172.21.15.106:0/4252326261 >> v2:172.21.15.171:3300/0 conn(0x7f3a90148670 0x7f3a900b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.323+0000 7f3a8effd640 1 --2- 172.21.15.106:0/4252326261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a900b6780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a9008c200 tx=0x7f3a8002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f52d1a6af39d387 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.323+0000 7f3a8dffb640 1 -- 172.21.15.106:0/4252326261 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80039070 con 0x7f3a900b63a0 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.323+0000 7f3a8dffb640 1 -- 172.21.15.106:0/4252326261 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8002cbf0 con 0x7f3a900b63a0 2024-04-16T12:57:37.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.323+0000 7f3a8dffb640 1 -- 172.21.15.106:0/4252326261 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80034440 con 0x7f3a900b63a0 2024-04-16T12:57:37.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 -- 172.21.15.106:0/4252326261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 msgr2=0x7f3a900b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 --2- 172.21.15.106:0/4252326261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a900b6780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a9008c200 tx=0x7f3a8002be40 comp rx=0 tx=0).stop 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 -- 172.21.15.106:0/4252326261 shutdown_connections 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 --2- 172.21.15.106:0/4252326261 >> v2:172.21.15.171:3300/0 conn(0x7f3a90148670 0x7f3a900b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 --2- 172.21.15.106:0/4252326261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a900b6780 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 -- 172.21.15.106:0/4252326261 >> 172.21.15.106:0/4252326261 conn(0x7f3a90068080 msgr2=0x7f3a900bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 -- 172.21.15.106:0/4252326261 shutdown_connections 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.324+0000 7f3a9533d640 1 -- 172.21.15.106:0/4252326261 wait complete. 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.325+0000 7f3a9533d640 1 Processor -- start 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.325+0000 7f3a9533d640 1 -- start start 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a9014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a901481c0 0x7f3a901e1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90148670 0x7f3a901e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900b5ce0 con 0x7f3a900b63a0 2024-04-16T12:57:37.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900b5b60 con 0x7f3a90148670 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3a90152610 con 0x7f3a901481c0 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a9014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a9014b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33188/0 (socket says 172.21.15.106:33188) 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 -- 172.21.15.106:0/2549548688 learned_addr learned my addr 172.21.15.106:0/2549548688 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8f7fe640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90148670 0x7f3a901e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8e7fc640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a901481c0 0x7f3a901e1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 -- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a901481c0 msgr2=0x7f3a901e1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a901481c0 0x7f3a901e1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 -- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90148670 msgr2=0x7f3a901e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90148670 0x7f3a901e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 -- 172.21.15.106:0/2549548688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9014c970 con 0x7f3a900b63a0 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8e7fc640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a901481c0 0x7f3a901e1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a8effd640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a9014b6d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a80037040 tx=0x7f3a80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a777fe640 1 -- 172.21.15.106:0/2549548688 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80039050 con 0x7f3a900b63a0 2024-04-16T12:57:37.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a777fe640 1 -- 172.21.15.106:0/2549548688 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a80045070 con 0x7f3a900b63a0 2024-04-16T12:57:37.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a777fe640 1 -- 172.21.15.106:0/2549548688 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8003e850 con 0x7f3a900b63a0 2024-04-16T12:57:37.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9014afb0 con 0x7f3a900b63a0 2024-04-16T12:57:37.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.326+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9014b250 con 0x7f3a900b63a0 2024-04-16T12:57:37.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.327+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a90075540 con 0x7f3a900b63a0 2024-04-16T12:57:37.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.328+0000 7f3a777fe640 1 -- 172.21.15.106:0/2549548688 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a8003e9f0 con 0x7f3a900b63a0 2024-04-16T12:57:37.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.328+0000 7f3a777fe640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f3a7c06c920 0x7f3a7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.329+0000 7f3a8e7fc640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f3a7c06c920 0x7f3a7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.329+0000 7f3a777fe640 1 -- 172.21.15.106:0/2549548688 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3a800ae830 con 0x7f3a900b63a0 2024-04-16T12:57:37.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.329+0000 7f3a8e7fc640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f3a7c06c920 0x7f3a7c06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a9014abc0 tx=0x7f3a84009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.333+0000 7f3a777fe640 1 -- 172.21.15.106:0/2549548688 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a90075540 con 0x7f3a900b63a0 2024-04-16T12:57:37.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.510+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a90147fe0 con 0x7f3a900b63a0 2024-04-16T12:57:37.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.511+0000 7f3a777fe640 1 -- 172.21.15.106:0/2549548688 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f3a90147fe0 con 0x7f3a900b63a0 2024-04-16T12:57:37.513 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:37.513 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f3a7c06c920 msgr2=0x7f3a7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f3a7c06c920 0x7f3a7c06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a9014abc0 tx=0x7f3a84009040 comp rx=0 tx=0).stop 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 msgr2=0x7f3a9014b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a9014b6d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a80037040 tx=0x7f3a80004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 shutdown_connections 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f3a7c06c920 0x7f3a7c06ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90148670 0x7f3a901e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a901481c0 0x7f3a901e1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 --2- 172.21.15.106:0/2549548688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a900b63a0 0x7f3a9014b6d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.513+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 >> 172.21.15.106:0/2549548688 conn(0x7f3a90068080 msgr2=0x7f3a90146fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:37.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.514+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 shutdown_connections 2024-04-16T12:57:37.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.514+0000 7f3a9533d640 1 -- 172.21.15.106:0/2549548688 wait complete. 2024-04-16T12:57:37.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:37.527 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:37.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.630+0000 7f14e41a8640 1 Processor -- start 2024-04-16T12:57:37.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.631+0000 7f14e41a8640 1 -- start start 2024-04-16T12:57:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.631+0000 7f14e41a8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14dc0734f0 0x7f14dc073970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.631+0000 7f14e41a8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14dc06d6a0 con 0x7f14dc06d2c0 2024-04-16T12:57:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.631+0000 7f14e41a8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14dc1450e0 con 0x7f14dc14d320 2024-04-16T12:57:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.631+0000 7f14e41a8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f14dc0ae3a0 con 0x7f14dc0734f0 2024-04-16T12:57:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.631+0000 7f14e1743640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14dc0734f0 0x7f14dc073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.632+0000 7f14e1743640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14dc0734f0 0x7f14dc073970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33200/0 (socket says 172.21.15.106:33200) 2024-04-16T12:57:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.631+0000 7f14e1f44640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f14dc06d2c0 0x7f14dc1449d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59468/0 (socket says 172.21.15.106:59468) 2024-04-16T12:57:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.632+0000 7f14e1743640 1 -- 172.21.15.106:0/2574134082 learned_addr learned my addr 172.21.15.106:0/2574134082 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.632+0000 7f14e1743640 1 -- 172.21.15.106:0/2574134082 >> v1:172.21.15.171:6789/0 conn(0x7f14dc14d320 legacy=0x7f14dc14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.632+0000 7f14e1743640 1 -- 172.21.15.106:0/2574134082 >> v1:172.21.15.106:6789/0 conn(0x7f14dc06d2c0 legacy=0x7f14dc1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.632+0000 7f14e1743640 1 -- 172.21.15.106:0/2574134082 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc0afa10 con 0x7f14dc0734f0 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.632+0000 7f14e1743640 1 --2- 172.21.15.106:0/2574134082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc073970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14d800bb10 tx=0x7f14d802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3876fd7a361bb221 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e0f42640 1 -- 172.21.15.106:0/2574134082 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d803b070 con 0x7f14dc0734f0 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e0f42640 1 -- 172.21.15.106:0/2574134082 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8036440 con 0x7f14dc0734f0 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e0f42640 1 -- 172.21.15.106:0/2574134082 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8036810 con 0x7f14dc0734f0 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e41a8640 1 -- 172.21.15.106:0/2574134082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 msgr2=0x7f14dc073970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e41a8640 1 --2- 172.21.15.106:0/2574134082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc073970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14d800bb10 tx=0x7f14d802e0e0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e41a8640 1 -- 172.21.15.106:0/2574134082 shutdown_connections 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e41a8640 1 --2- 172.21.15.106:0/2574134082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc073970 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e41a8640 1 -- 172.21.15.106:0/2574134082 >> 172.21.15.106:0/2574134082 conn(0x7f14dc0b92c0 msgr2=0x7f14dc0b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e41a8640 1 -- 172.21.15.106:0/2574134082 shutdown_connections 2024-04-16T12:57:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.633+0000 7f14e41a8640 1 -- 172.21.15.106:0/2574134082 wait complete. 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.634+0000 7f14e41a8640 1 Processor -- start 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.634+0000 7f14e41a8640 1 -- start start 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e41a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14dc06d2c0 0x7f14dc13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e41a8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc1376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e41a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14dc14d320 0x7f14dc071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e41a8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc06e340 con 0x7f14dc0734f0 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e41a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc0b5230 con 0x7f14dc06d2c0 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e41a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc0b03f0 con 0x7f14dc14d320 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc1376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc1376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33216/0 (socket says 172.21.15.106:33216) 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 -- 172.21.15.106:0/3917765176 learned_addr learned my addr 172.21.15.106:0/3917765176 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1f44640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14dc06d2c0 0x7f14dc13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e2745640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14dc14d320 0x7f14dc071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 -- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14dc14d320 msgr2=0x7f14dc071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14dc14d320 0x7f14dc071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 -- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14dc06d2c0 msgr2=0x7f14dc13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14dc06d2c0 0x7f14dc13c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 -- 172.21.15.106:0/3917765176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc13add0 con 0x7f14dc0734f0 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e2745640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14dc14d320 0x7f14dc071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e1743640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc1376d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14d800b2c0 tx=0x7f14d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14ce7fc640 1 -- 172.21.15.106:0/3917765176 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8045070 con 0x7f14dc0734f0 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14ce7fc640 1 -- 172.21.15.106:0/3917765176 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8040890 con 0x7f14dc0734f0 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc13b0b0 con 0x7f14dc0734f0 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.635+0000 7f14ce7fc640 1 -- 172.21.15.106:0/3917765176 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d803b040 con 0x7f14dc0734f0 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.636+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc137c10 con 0x7f14dc0734f0 2024-04-16T12:57:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.636+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14dc068a90 con 0x7f14dc0734f0 2024-04-16T12:57:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.637+0000 7f14ce7fc640 1 -- 172.21.15.106:0/3917765176 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14d8048070 con 0x7f14dc0734f0 2024-04-16T12:57:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.637+0000 7f14ce7fc640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f14c006c8f0 0x7f14c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.637+0000 7f14ce7fc640 1 -- 172.21.15.106:0/3917765176 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f14d80b08a0 con 0x7f14dc0734f0 2024-04-16T12:57:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.637+0000 7f14e1f44640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f14c006c8f0 0x7f14c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.638+0000 7f14e1f44640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f14c006c8f0 0x7f14c006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14d0007fd0 tx=0x7f14d0007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.642+0000 7f14ce7fc640 1 -- 172.21.15.106:0/3917765176 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14d807e830 con 0x7f14dc0734f0 2024-04-16T12:57:37.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.819+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f14dc06c9c0 con 0x7f14dc0734f0 2024-04-16T12:57:37.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.819+0000 7f14ce7fc640 1 -- 172.21.15.106:0/3917765176 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f14d8082b30 con 0x7f14dc0734f0 2024-04-16T12:57:37.821 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:37.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f14c006c8f0 msgr2=0x7f14c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f14c006c8f0 0x7f14c006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14d0007fd0 tx=0x7f14d0007e80 comp rx=0 tx=0).stop 2024-04-16T12:57:37.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 msgr2=0x7f14dc1376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc1376d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14d800b2c0 tx=0x7f14d80046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 shutdown_connections 2024-04-16T12:57:37.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f14c006c8f0 0x7f14c006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14dc14d320 0x7f14dc071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc0734f0 0x7f14dc1376d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 --2- 172.21.15.106:0/3917765176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14dc06d2c0 0x7f14dc13c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 >> 172.21.15.106:0/3917765176 conn(0x7f14dc0b92c0 msgr2=0x7f14dc0b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:37.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 shutdown_connections 2024-04-16T12:57:37.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.821+0000 7f14e41a8640 1 -- 172.21.15.106:0/3917765176 wait complete. 2024-04-16T12:57:37.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:37.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.938+0000 7fd82cf96640 1 Processor -- start 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.938+0000 7fd82cf96640 1 -- start start 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd82cf96640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd8280b6030 0x7fd8280b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd82cf96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828140180 0x7fd828150500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd82cf96640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8280b6410 con 0x7fd8280739b0 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd82cf96640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd8280b6b20 con 0x7fd8280b6030 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd82cf96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd8280b40b0 con 0x7fd828140180 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd825d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd8280739b0 0x7fd82813fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59480/0 (socket says 172.21.15.106:59480) 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd825d9b640 1 -- 172.21.15.106:0/3223662801 learned_addr learned my addr 172.21.15.106:0/3223662801 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd826d9d640 1 --2- 172.21.15.106:0/3223662801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828140180 0x7fd828150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.939+0000 7fd82659c640 1 --2- 172.21.15.106:0/3223662801 >> v2:172.21.15.171:3300/0 conn(0x7fd8280b6030 0x7fd8280b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.940+0000 7fd826d9d640 1 -- 172.21.15.106:0/3223662801 >> v2:172.21.15.171:3300/0 conn(0x7fd8280b6030 msgr2=0x7fd8280b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:37.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.940+0000 7fd826d9d640 1 --2- 172.21.15.106:0/3223662801 >> v2:172.21.15.171:3300/0 conn(0x7fd8280b6030 0x7fd8280b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.940+0000 7fd826d9d640 1 -- 172.21.15.106:0/3223662801 >> v1:172.21.15.106:6789/0 conn(0x7fd8280739b0 legacy=0x7fd82813fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.940+0000 7fd826d9d640 1 -- 172.21.15.106:0/3223662801 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8280b4390 con 0x7fd828140180 2024-04-16T12:57:37.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.940+0000 7fd82659c640 1 --2- 172.21.15.106:0/3223662801 >> v2:172.21.15.171:3300/0 conn(0x7fd8280b6030 0x7fd8280b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:37.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.941+0000 7fd826d9d640 1 --2- 172.21.15.106:0/3223662801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828140180 0x7fd828150500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8180097a0 tx=0x7fd81802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a91118a49eb0991 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.941+0000 7fd82559a640 1 -- 172.21.15.106:0/3223662801 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd818038070 con 0x7fd828140180 2024-04-16T12:57:37.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.941+0000 7fd82559a640 1 -- 172.21.15.106:0/3223662801 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd818031700 con 0x7fd828140180 2024-04-16T12:57:37.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.941+0000 7fd82559a640 1 -- 172.21.15.106:0/3223662801 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd818031ad0 con 0x7fd828140180 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 -- 172.21.15.106:0/3223662801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828140180 msgr2=0x7fd828150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 --2- 172.21.15.106:0/3223662801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828140180 0x7fd828150500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8180097a0 tx=0x7fd81802b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 -- 172.21.15.106:0/3223662801 shutdown_connections 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 --2- 172.21.15.106:0/3223662801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828140180 0x7fd828150500 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 --2- 172.21.15.106:0/3223662801 >> v2:172.21.15.171:3300/0 conn(0x7fd8280b6030 0x7fd8280b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 -- 172.21.15.106:0/3223662801 >> 172.21.15.106:0/3223662801 conn(0x7fd82806d370 msgr2=0x7fd8280b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 -- 172.21.15.106:0/3223662801 shutdown_connections 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.942+0000 7fd82cf96640 1 -- 172.21.15.106:0/3223662801 wait complete. 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 Processor -- start 2024-04-16T12:57:37.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 -- start start 2024-04-16T12:57:37.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8280b6030 0x7fd8280b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd828140180 0x7fd828139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828136e30 0x7fd828136000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280b1990 con 0x7fd8280b6030 2024-04-16T12:57:37.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280b1810 con 0x7fd828140180 2024-04-16T12:57:37.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.943+0000 7fd82cf96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd8280b1b10 con 0x7fd828136e30 2024-04-16T12:57:37.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8280b6030 0x7fd8280b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8280b6030 0x7fd8280b8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33226/0 (socket says 172.21.15.106:33226) 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 -- 172.21.15.106:0/233025664 learned_addr learned my addr 172.21.15.106:0/233025664 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd826d9d640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828136e30 0x7fd828136000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd825d9b640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd828140180 0x7fd828139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 -- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828136e30 msgr2=0x7fd828136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828136e30 0x7fd828136000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 -- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd828140180 msgr2=0x7fd828139ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd828140180 0x7fd828139ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 -- 172.21.15.106:0/233025664 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd828132250 con 0x7fd8280b6030 2024-04-16T12:57:37.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82659c640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8280b6030 0x7fd8280b8d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd82000ec10 tx=0x7fd82000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd816ffd640 1 -- 172.21.15.106:0/233025664 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820017070 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd816ffd640 1 -- 172.21.15.106:0/233025664 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82000cc30 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd816ffd640 1 -- 172.21.15.106:0/233025664 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820013470 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd828137310 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.944+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd828137a80 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.945+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8280691a0 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.946+0000 7fd816ffd640 1 -- 172.21.15.106:0/233025664 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd82001a070 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.946+0000 7fd816ffd640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd80806c920 0x7fd80806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.946+0000 7fd816ffd640 1 -- 172.21.15.106:0/233025664 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd82008bcc0 con 0x7fd8280b6030 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.946+0000 7fd825d9b640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd80806c920 0x7fd80806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:37.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.947+0000 7fd825d9b640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd80806c920 0x7fd80806ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd82813f420 tx=0x7fd81c001990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:37.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:37.950+0000 7fd816ffd640 1 -- 172.21.15.106:0/233025664 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd820059b30 con 0x7fd8280b6030 2024-04-16T12:57:38.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.127+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd828132420 con 0x7fd8280b6030 2024-04-16T12:57:38.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.128+0000 7fd816ffd640 1 -- 172.21.15.106:0/233025664 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd82005de30 con 0x7fd8280b6030 2024-04-16T12:57:38.129 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd80806c920 msgr2=0x7fd80806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd80806c920 0x7fd80806ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd82813f420 tx=0x7fd81c001990 comp rx=0 tx=0).stop 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8280b6030 msgr2=0x7fd8280b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8280b6030 0x7fd8280b8d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd82000ec10 tx=0x7fd82000c520 comp rx=0 tx=0).stop 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 shutdown_connections 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd80806c920 0x7fd80806ede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd828136e30 0x7fd828136000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd828140180 0x7fd828139ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 --2- 172.21.15.106:0/233025664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8280b6030 0x7fd8280b8d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 >> 172.21.15.106:0/233025664 conn(0x7fd82806d370 msgr2=0x7fd82806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 shutdown_connections 2024-04-16T12:57:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.130+0000 7fd82cf96640 1 -- 172.21.15.106:0/233025664 wait complete. 2024-04-16T12:57:38.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:38.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0ee1df4640 1 Processor -- start 2024-04-16T12:57:38.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0ee1df4640 1 -- start start 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0ee1df4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0edc0b6100 0x7f0edc141a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0ee1df4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc141fd0 0x7f0edc1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0ee1df4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0edc0b7c80 con 0x7f0edc0b78a0 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0ee1df4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f0edc0b6f80 con 0x7f0edc0b6100 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0ee1df4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc0b1d80 con 0x7f0edc141fd0 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0edaffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0edc0b6100 0x7f0edc141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.247+0000 7f0edb7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0edc0b78a0 0x7f0edc06dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59484/0 (socket says 172.21.15.106:59484) 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0edb7fe640 1 -- 172.21.15.106:0/1322188939 learned_addr learned my addr 172.21.15.106:0/1322188939 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0edbfff640 1 --2- 172.21.15.106:0/1322188939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc141fd0 0x7f0edc1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0edaffd640 1 -- 172.21.15.106:0/1322188939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc141fd0 msgr2=0x7f0edc1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:38.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0edaffd640 1 --2- 172.21.15.106:0/1322188939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc141fd0 0x7f0edc1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0edaffd640 1 -- 172.21.15.106:0/1322188939 >> v1:172.21.15.106:6789/0 conn(0x7f0edc0b78a0 legacy=0x7f0edc06dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0edaffd640 1 -- 172.21.15.106:0/1322188939 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc06e6f0 con 0x7f0edc0b6100 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0eda7fc640 1 -- 172.21.15.106:0/1322188939 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198119061 0 0) 0x7f0edc0b7c80 con 0x7f0edc0b78a0 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.248+0000 7f0edbfff640 1 --2- 172.21.15.106:0/1322188939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc141fd0 0x7f0edc1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0edaffd640 1 --2- 172.21.15.106:0/1322188939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc0b6100 0x7f0edc141a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00097a0 tx=0x7f0ed002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764412da85550437 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0eda7fc640 1 -- 172.21.15.106:0/1322188939 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0038070 con 0x7f0edc0b6100 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0eda7fc640 1 -- 172.21.15.106:0/1322188939 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed0031700 con 0x7f0edc0b6100 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0eda7fc640 1 -- 172.21.15.106:0/1322188939 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0031ad0 con 0x7f0edc0b6100 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1322188939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc0b6100 msgr2=0x7f0edc141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1322188939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc0b6100 0x7f0edc141a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00097a0 tx=0x7f0ed002b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1322188939 shutdown_connections 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1322188939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc141fd0 0x7f0edc1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1322188939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc0b6100 0x7f0edc141a90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1322188939 >> 172.21.15.106:0/1322188939 conn(0x7f0edc0b7e90 msgr2=0x7f0edc0b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:38.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1322188939 shutdown_connections 2024-04-16T12:57:38.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.249+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1322188939 wait complete. 2024-04-16T12:57:38.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.250+0000 7f0ee1df4640 1 Processor -- start 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.250+0000 7f0ee1df4640 1 -- start start 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0ee1df4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0edc0b6100 0x7f0edc0b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0ee1df4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc0b78a0 0x7f0edc1dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0ee1df4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc141fd0 0x7f0edc1dd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0ee1df4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc0b6ba0 con 0x7f0edc141fd0 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0ee1df4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc0b22a0 con 0x7f0edc0b6100 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0ee1df4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc0b6d20 con 0x7f0edc0b78a0 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc141fd0 0x7f0edc1dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc141fd0 0x7f0edc1dd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33252/0 (socket says 172.21.15.106:33252) 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 -- 172.21.15.106:0/1454554295 learned_addr learned my addr 172.21.15.106:0/1454554295 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edaffd640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc0b78a0 0x7f0edc1dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edb7fe640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0edc0b6100 0x7f0edc0b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 -- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc0b78a0 msgr2=0x7f0edc1dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc0b78a0 0x7f0edc1dd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 -- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0edc0b6100 msgr2=0x7f0edc0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0edc0b6100 0x7f0edc0b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edbfff640 1 -- 172.21.15.106:0/1454554295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc144870 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.251+0000 7f0edb7fe640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0edc0b6100 0x7f0edc0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.252+0000 7f0edbfff640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc141fd0 0x7f0edc1dd900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009fa0 tx=0x7f0ed400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.252+0000 7f0ec3fff640 1 -- 172.21.15.106:0/1454554295 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed401a070 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.252+0000 7f0ec3fff640 1 -- 172.21.15.106:0/1454554295 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4003bb0 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.252+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0edc145480 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.252+0000 7f0ec3fff640 1 -- 172.21.15.106:0/1454554295 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4004030 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.252+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0edc0b41c0 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.253+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0edc068a90 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.253+0000 7f0ec3fff640 1 -- 172.21.15.106:0/1454554295 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ed401d070 con 0x7f0edc141fd0 2024-04-16T12:57:38.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.254+0000 7f0ec3fff640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ec806c8f0 0x7f0ec806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.254+0000 7f0ec3fff640 1 -- 172.21.15.106:0/1454554295 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ed408bd70 con 0x7f0edc141fd0 2024-04-16T12:57:38.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.254+0000 7f0edb7fe640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ec806c8f0 0x7f0ec806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.254+0000 7f0edb7fe640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ec806c8f0 0x7f0ec806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000f60 tx=0x7f0ecc007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.258+0000 7f0ec3fff640 1 -- 172.21.15.106:0/1454554295 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ed4010070 con 0x7f0edc141fd0 2024-04-16T12:57:38.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.433+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0edc1486a0 con 0x7f0edc141fd0 2024-04-16T12:57:38.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.434+0000 7f0ec3fff640 1 -- 172.21.15.106:0/1454554295 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f0ed4059be0 con 0x7f0edc141fd0 2024-04-16T12:57:38.436 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ec806c8f0 msgr2=0x7f0ec806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ec806c8f0 0x7f0ec806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000f60 tx=0x7f0ecc007c10 comp rx=0 tx=0).stop 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc141fd0 msgr2=0x7f0edc1dd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc141fd0 0x7f0edc1dd900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009fa0 tx=0x7f0ed400d560 comp rx=0 tx=0).stop 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 shutdown_connections 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ec806c8f0 0x7f0ec806edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0edc141fd0 0x7f0edc1dd900 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0edc0b78a0 0x7f0edc1dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 --2- 172.21.15.106:0/1454554295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0edc0b6100 0x7f0edc0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 >> 172.21.15.106:0/1454554295 conn(0x7f0edc0b7e90 msgr2=0x7f0edc074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:38.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 shutdown_connections 2024-04-16T12:57:38.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.436+0000 7f0ee1df4640 1 -- 172.21.15.106:0/1454554295 wait complete. 2024-04-16T12:57:38.473 INFO:tasks.cephfs_test_runner:Starting test: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) Test that when cd is issued with an argument, CWD is changed 2024-04-16T12:57:38.473 INFO:tasks.cephfs_test_runner:test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-16T12:57:38.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:38.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 Processor -- start 2024-04-16T12:57:38.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 -- start start 2024-04-16T12:57:38.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3d40b4a50 0x7fa3d409d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa3d40afee0 0x7fa3d40b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d4144b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d4145070 con 0x7fa3d40b4a50 2024-04-16T12:57:38.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d40b3fc0 con 0x7fa3d40afee0 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.576+0000 7fa3db650640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d40b9720 con 0x7fa3d41446a0 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3d40b4a50 0x7fa3d409d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3d40b4a50 0x7fa3d409d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33264/0 (socket says 172.21.15.106:33264) 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 -- 172.21.15.106:0/4282909435 learned_addr learned my addr 172.21.15.106:0/4282909435 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d8beb640 1 --2- 172.21.15.106:0/4282909435 >> v2:172.21.15.171:3300/0 conn(0x7fa3d40afee0 0x7fa3d40b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d9bed640 1 --2- 172.21.15.106:0/4282909435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d4144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 -- 172.21.15.106:0/4282909435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 msgr2=0x7fa3d4144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 --2- 172.21.15.106:0/4282909435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d4144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 -- 172.21.15.106:0/4282909435 >> v2:172.21.15.171:3300/0 conn(0x7fa3d40afee0 msgr2=0x7fa3d40b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 --2- 172.21.15.106:0/4282909435 >> v2:172.21.15.171:3300/0 conn(0x7fa3d40afee0 0x7fa3d40b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.577+0000 7fa3d93ec640 1 -- 172.21.15.106:0/4282909435 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d40b9a00 con 0x7fa3d40b4a50 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3d93ec640 1 --2- 172.21.15.106:0/4282909435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40b4a50 0x7fa3d409d7f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3d409d560 tx=0x7fa3c402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8645495dc49462cc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3d3fff640 1 -- 172.21.15.106:0/4282909435 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c403b070 con 0x7fa3d40b4a50 2024-04-16T12:57:38.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3d3fff640 1 -- 172.21.15.106:0/4282909435 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c402ee00 con 0x7fa3d40b4a50 2024-04-16T12:57:38.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3d3fff640 1 -- 172.21.15.106:0/4282909435 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4036660 con 0x7fa3d40b4a50 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 -- 172.21.15.106:0/4282909435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40b4a50 msgr2=0x7fa3d409d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 --2- 172.21.15.106:0/4282909435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40b4a50 0x7fa3d409d7f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3d409d560 tx=0x7fa3c402e050 comp rx=0 tx=0).stop 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 -- 172.21.15.106:0/4282909435 shutdown_connections 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 --2- 172.21.15.106:0/4282909435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d4144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 --2- 172.21.15.106:0/4282909435 >> v2:172.21.15.171:3300/0 conn(0x7fa3d40afee0 0x7fa3d40b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 --2- 172.21.15.106:0/4282909435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40b4a50 0x7fa3d409d7f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 -- 172.21.15.106:0/4282909435 >> 172.21.15.106:0/4282909435 conn(0x7fa3d409cc10 msgr2=0x7fa3d406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 -- 172.21.15.106:0/4282909435 shutdown_connections 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.578+0000 7fa3db650640 1 -- 172.21.15.106:0/4282909435 wait complete. 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.579+0000 7fa3db650640 1 Processor -- start 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.579+0000 7fa3db650640 1 -- start start 2024-04-16T12:57:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3db650640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40afee0 0x7fa3d40b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3db650640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3d40b4a50 0x7fa3d4146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3db650640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d41471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3db650640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40b93b0 con 0x7fa3d40afee0 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3db650640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40b4e30 con 0x7fa3d40b4a50 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3db650640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d406d890 con 0x7fa3d41446a0 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40afee0 0x7fa3d40b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40afee0 0x7fa3d40b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33276/0 (socket says 172.21.15.106:33276) 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 -- 172.21.15.106:0/544739682 learned_addr learned my addr 172.21.15.106:0/544739682 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d9bed640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d41471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d8beb640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3d40b4a50 0x7fa3d4146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 -- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 msgr2=0x7fa3d41471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d41471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 -- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3d40b4a50 msgr2=0x7fa3d4146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3d40b4a50 0x7fa3d4146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d93ec640 1 -- 172.21.15.106:0/544739682 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d40b3390 con 0x7fa3d40afee0 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d9bed640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d41471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.580+0000 7fa3d8beb640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3d40b4a50 0x7fa3d4146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.581+0000 7fa3d93ec640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40afee0 0x7fa3d40b19d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa3c402e090 tx=0x7fa3c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.581+0000 7fa3d1ffb640 1 -- 172.21.15.106:0/544739682 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c403b070 con 0x7fa3d40afee0 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.581+0000 7fa3d1ffb640 1 -- 172.21.15.106:0/544739682 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c403f550 con 0x7fa3d40afee0 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.581+0000 7fa3d1ffb640 1 -- 172.21.15.106:0/544739682 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c403f940 con 0x7fa3d40afee0 2024-04-16T12:57:38.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.581+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d40b2060 con 0x7fa3d40afee0 2024-04-16T12:57:38.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.581+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d40b2d10 con 0x7fa3d40afee0 2024-04-16T12:57:38.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.582+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d4068a90 con 0x7fa3d40afee0 2024-04-16T12:57:38.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.582+0000 7fa3d1ffb640 1 -- 172.21.15.106:0/544739682 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3c4048060 con 0x7fa3d40afee0 2024-04-16T12:57:38.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.583+0000 7fa3d1ffb640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3c006c8f0 0x7fa3c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.583+0000 7fa3d1ffb640 1 -- 172.21.15.106:0/544739682 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa3c40ad670 con 0x7fa3d40afee0 2024-04-16T12:57:38.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.583+0000 7fa3d8beb640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3c006c8f0 0x7fa3c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.583+0000 7fa3d8beb640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3c006c8f0 0x7fa3c006edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40b8cc0 tx=0x7fa3c800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.587+0000 7fa3d1ffb640 1 -- 172.21.15.106:0/544739682 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3c407bb30 con 0x7fa3d40afee0 2024-04-16T12:57:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.762+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3d40b2230 con 0x7fa3d40afee0 2024-04-16T12:57:38.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.763+0000 7fa3d1ffb640 1 -- 172.21.15.106:0/544739682 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fa3c407b430 con 0x7fa3d40afee0 2024-04-16T12:57:38.765 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:38.765 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:38.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.765+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3c006c8f0 msgr2=0x7fa3c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.765+0000 7fa3db650640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3c006c8f0 0x7fa3c006edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40b8cc0 tx=0x7fa3c800b040 comp rx=0 tx=0).stop 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.765+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40afee0 msgr2=0x7fa3d40b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.765+0000 7fa3db650640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40afee0 0x7fa3d40b19d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa3c402e090 tx=0x7fa3c4004730 comp rx=0 tx=0).stop 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 shutdown_connections 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa3c006c8f0 0x7fa3c006edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3d41446a0 0x7fa3d41471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3d40b4a50 0x7fa3d4146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 --2- 172.21.15.106:0/544739682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3d40afee0 0x7fa3d40b19d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 >> 172.21.15.106:0/544739682 conn(0x7fa3d409cc10 msgr2=0x7fa3d40af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 shutdown_connections 2024-04-16T12:57:38.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.766+0000 7fa3db650640 1 -- 172.21.15.106:0/544739682 wait complete. 2024-04-16T12:57:38.778 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:38.779 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:38.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.883+0000 7fef54522640 1 Processor -- start 2024-04-16T12:57:38.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.883+0000 7fef54522640 1 -- start start 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef54522640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fef4c1421a0 0x7fef4c153600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef54522640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c0b7c80 con 0x7fef4c0b6100 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef54522640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c0b6f80 con 0x7fef4c0b78a0 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef54522640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fef4c0b1d80 con 0x7fef4c1421a0 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef51abd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fef4c0b6100 0x7fef4c141a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59486/0 (socket says 172.21.15.106:59486) 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef51abd640 1 -- 172.21.15.106:0/4097619335 learned_addr learned my addr 172.21.15.106:0/4097619335 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815210445 0 0) 0x7fef4c0b7c80 con 0x7fef4c0b6100 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef52abf640 1 --2- 172.21.15.106:0/4097619335 >> v2:172.21.15.171:3300/0 conn(0x7fef4c1421a0 0x7fef4c153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef38003520 con 0x7fef4c0b6100 2024-04-16T12:57:38.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.884+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219162140 0 0) 0x7fef38003520 con 0x7fef4c0b6100 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 >> v2:172.21.15.171:3300/0 conn(0x7fef4c1421a0 msgr2=0x7fef4c153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 --2- 172.21.15.106:0/4097619335 >> v2:172.21.15.171:3300/0 conn(0x7fef4c1421a0 0x7fef4c153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 >> v1:172.21.15.171:6789/0 conn(0x7fef4c0b78a0 legacy=0x7fef4c06dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c06e6f0 con 0x7fef4c0b6100 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fef3c001670 con 0x7fef4c0b6100 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 >> v1:172.21.15.106:6789/0 conn(0x7fef4c0b6100 legacy=0x7fef4c141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef38004800 0x7fef38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef380052e0 0x7fef3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0b1d80 con 0x7fef380052e0 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef3800c1b0 con 0x7fef380039b0 2024-04-16T12:57:38.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef3800c3b0 con 0x7fef38004800 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef52abf640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef380052e0 0x7fef3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef522be640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef51abd640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef38004800 0x7fef38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef52abf640 1 -- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef38004800 msgr2=0x7fef38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef52abf640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef38004800 0x7fef38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef52abf640 1 -- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef380039b0 msgr2=0x7fef38003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef52abf640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef52abf640 1 -- 172.21.15.106:0/4097619335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38003520 con 0x7fef380052e0 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.885+0000 7fef51abd640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef38004800 0x7fef38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef52abf640 1 -- 172.21.15.106:0/4097619335 reap_dead start 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef52abf640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef380052e0 0x7fef3800b9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef44009f90 tx=0x7fef38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468569dfa7bf480a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44009c10 con 0x7fef380052e0 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4402cc20 con 0x7fef380052e0 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef512bc640 1 -- 172.21.15.106:0/4097619335 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44003990 con 0x7fef380052e0 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef54522640 1 -- 172.21.15.106:0/4097619335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef380052e0 msgr2=0x7fef3800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef54522640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef380052e0 0x7fef3800b9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef44009f90 tx=0x7fef38005830 comp rx=0 tx=0).stop 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef54522640 1 -- 172.21.15.106:0/4097619335 shutdown_connections 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef54522640 1 --2- 172.21.15.106:0/4097619335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef380052e0 0x7fef3800b9c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.886+0000 7fef54522640 1 -- 172.21.15.106:0/4097619335 >> 172.21.15.106:0/4097619335 conn(0x7fef4c0b7e90 msgr2=0x7fef4c0b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.887+0000 7fef54522640 1 -- 172.21.15.106:0/4097619335 shutdown_connections 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.887+0000 7fef54522640 1 -- 172.21.15.106:0/4097619335 wait complete. 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 Processor -- start 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 -- start start 2024-04-16T12:57:38.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef380052e0 0x7fef4c144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef4c1479d0 0x7fef4c1dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef4c144800 0x7fef4c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0b6d20 con 0x7fef4c144800 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0b6ba0 con 0x7fef4c1479d0 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef54522640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c0b5d90 con 0x7fef380052e0 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef52abf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef4c144800 0x7fef4c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef52abf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef4c144800 0x7fef4c0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33294/0 (socket says 172.21.15.106:33294) 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef52abf640 1 -- 172.21.15.106:0/1644086943 learned_addr learned my addr 172.21.15.106:0/1644086943 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef522be640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef380052e0 0x7fef4c144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.888+0000 7fef51abd640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef4c1479d0 0x7fef4c1dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef52abf640 1 -- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef380052e0 msgr2=0x7fef4c144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef52abf640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef380052e0 0x7fef4c144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef52abf640 1 -- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef4c1479d0 msgr2=0x7fef4c1dcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef52abf640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef4c1479d0 0x7fef4c1dcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef52abf640 1 -- 172.21.15.106:0/1644086943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c143a20 con 0x7fef4c144800 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef522be640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef380052e0 0x7fef4c144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef52abf640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef4c144800 0x7fef4c0b4ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e200 tx=0x7fef44009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef42ffd640 1 -- 172.21.15.106:0/1644086943 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44009c10 con 0x7fef4c144800 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef42ffd640 1 -- 172.21.15.106:0/1644086943 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef44045070 con 0x7fef4c144800 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c144f60 con 0x7fef4c144800 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef42ffd640 1 -- 172.21.15.106:0/1644086943 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4403e850 con 0x7fef4c144800 2024-04-16T12:57:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.889+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c148530 con 0x7fef4c144800 2024-04-16T12:57:38.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.890+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c06c210 con 0x7fef4c144800 2024-04-16T12:57:38.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.890+0000 7fef42ffd640 1 -- 172.21.15.106:0/1644086943 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef44005d10 con 0x7fef4c144800 2024-04-16T12:57:38.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.891+0000 7fef42ffd640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fef3006c920 0x7fef3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:38.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.891+0000 7fef522be640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fef3006c920 0x7fef3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:38.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.891+0000 7fef42ffd640 1 -- 172.21.15.106:0/1644086943 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fef440ae250 con 0x7fef4c144800 2024-04-16T12:57:38.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.891+0000 7fef522be640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fef3006c920 0x7fef3006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef48000c00 tx=0x7fef48009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:38.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:38.895+0000 7fef42ffd640 1 -- 172.21.15.106:0/1644086943 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef4407c7a0 con 0x7fef4c144800 2024-04-16T12:57:39.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.073+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef4c147db0 con 0x7fef4c144800 2024-04-16T12:57:39.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.073+0000 7fef42ffd640 1 -- 172.21.15.106:0/1644086943 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fef4407c0a0 con 0x7fef4c144800 2024-04-16T12:57:39.075 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:39.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fef3006c920 msgr2=0x7fef3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fef3006c920 0x7fef3006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef48000c00 tx=0x7fef48009040 comp rx=0 tx=0).stop 2024-04-16T12:57:39.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef4c144800 msgr2=0x7fef4c0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef4c144800 0x7fef4c0b4ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e200 tx=0x7fef44009750 comp rx=0 tx=0).stop 2024-04-16T12:57:39.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 shutdown_connections 2024-04-16T12:57:39.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fef3006c920 0x7fef3006ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef4c144800 0x7fef4c0b4ca0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef4c1479d0 0x7fef4c1dcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 --2- 172.21.15.106:0/1644086943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef380052e0 0x7fef4c144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 >> 172.21.15.106:0/1644086943 conn(0x7fef4c0b7e90 msgr2=0x7fef4c13d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:39.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 shutdown_connections 2024-04-16T12:57:39.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.075+0000 7fef54522640 1 -- 172.21.15.106:0/1644086943 wait complete. 2024-04-16T12:57:39.088 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.192+0000 7f7649441640 1 Processor -- start 2024-04-16T12:57:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f7649441640 1 -- start start 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f7649441640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7644072eb0 0x7f76440b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f7649441640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76441451c0 0x7f764414f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f7649441640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7644073290 con 0x7f76440b39a0 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f7649441640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f76440b49a0 con 0x7f7644072eb0 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f7649441640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76440b41a0 con 0x7f76441451c0 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f76427fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f76440b39a0 0x7f7644144ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59498/0 (socket says 172.21.15.106:59498) 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f76427fc640 1 -- 172.21.15.106:0/208896896 learned_addr learned my addr 172.21.15.106:0/208896896 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f7642ffd640 1 --2- 172.21.15.106:0/208896896 >> v2:172.21.15.171:3300/0 conn(0x7f7644072eb0 0x7f76440b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.193+0000 7f76437fe640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76441451c0 0x7f764414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708848667 0 0) 0x7f7644073290 con 0x7f76440b39a0 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f762c003520 con 0x7f76440b39a0 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2822202195 0 0) 0x7f762c003520 con 0x7f76440b39a0 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76441451c0 msgr2=0x7f764414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76441451c0 0x7f764414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 >> v2:172.21.15.171:3300/0 conn(0x7f7644072eb0 msgr2=0x7f76440b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 --2- 172.21.15.106:0/208896896 >> v2:172.21.15.171:3300/0 conn(0x7f7644072eb0 0x7f76440b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76440b4480 con 0x7f76440b39a0 2024-04-16T12:57:39.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f7638001670 con 0x7f76440b39a0 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7642ffd640 1 --2- 172.21.15.106:0/208896896 >> v2:172.21.15.171:3300/0 conn(0x7f7644072eb0 0x7f76440b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 >> v1:172.21.15.106:6789/0 conn(0x7f76440b39a0 legacy=0x7f7644144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c0039b0 0x7f762c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f762c004310 0x7f762c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f762c004ef0 0x7f762c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f76440b41a0 con 0x7f762c004ef0 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f762c00bf00 con 0x7f762c004310 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f762c00c080 con 0x7f762c0039b0 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f76437fe640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f762c004ef0 0x7f762c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f7642ffd640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c0039b0 0x7f762c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f76427fc640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f762c004310 0x7f762c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f76437fe640 1 -- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c0039b0 msgr2=0x7f762c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:39.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f76437fe640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c0039b0 0x7f762c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f76437fe640 1 -- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f762c004310 msgr2=0x7f762c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f76437fe640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f762c004310 0x7f762c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.194+0000 7f76437fe640 1 -- 172.21.15.106:0/208896896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c003520 con 0x7f762c004ef0 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.195+0000 7f76437fe640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f762c004ef0 0x7f762c00b9c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f763c009a90 tx=0x7f762c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05264a78155808f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.195+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c039070 con 0x7f762c004ef0 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.195+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c02c680 con 0x7f762c004ef0 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.195+0000 7f7641ffb640 1 -- 172.21.15.106:0/208896896 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c009690 con 0x7f762c004ef0 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.196+0000 7f7649441640 1 -- 172.21.15.106:0/208896896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f762c004ef0 msgr2=0x7f762c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.196+0000 7f7649441640 1 --2- 172.21.15.106:0/208896896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f762c004ef0 0x7f762c00b9c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f763c009a90 tx=0x7f762c005830 comp rx=0 tx=0).stop 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.196+0000 7f76437fe640 1 -- 172.21.15.106:0/208896896 reap_dead start 2024-04-16T12:57:39.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.196+0000 7f7649441640 1 -- 172.21.15.106:0/208896896 shutdown_connections 2024-04-16T12:57:39.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.196+0000 7f7649441640 1 -- 172.21.15.106:0/208896896 >> 172.21.15.106:0/208896896 conn(0x7f76440ba460 msgr2=0x7f76440ba870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:39.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.196+0000 7f7649441640 1 -- 172.21.15.106:0/208896896 shutdown_connections 2024-04-16T12:57:39.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.196+0000 7f7649441640 1 -- 172.21.15.106:0/208896896 wait complete. 2024-04-16T12:57:39.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.197+0000 7f7649441640 1 Processor -- start 2024-04-16T12:57:39.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.197+0000 7f7649441640 1 -- start start 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c004ef0 0x7f764413c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f764413cc00 0x7f76441e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441e1230 0x7f76441dd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7644072450 con 0x7f764413cc00 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7644071b60 con 0x7f76441e1230 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76440725d0 con 0x7f762c004ef0 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f764413cc00 0x7f76441e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f764413cc00 0x7f76441e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33318/0 (socket says 172.21.15.106:33318) 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 -- 172.21.15.106:0/4024363773 learned_addr learned my addr 172.21.15.106:0/4024363773 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7642ffd640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c004ef0 0x7f764413c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76437fe640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441e1230 0x7f76441dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 -- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c004ef0 msgr2=0x7f764413c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c004ef0 0x7f764413c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 -- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441e1230 msgr2=0x7f76441dd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441e1230 0x7f76441dd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 -- 172.21.15.106:0/4024363773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7644140450 con 0x7f764413cc00 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7642ffd640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c004ef0 0x7f764413c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76437fe640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441e1230 0x7f76441dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f76427fc640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f764413cc00 0x7f76441e0cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7638007340 tx=0x7f7638007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f762b7fe640 1 -- 172.21.15.106:0/4024363773 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763800f940 con 0x7f764413cc00 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f762b7fe640 1 -- 172.21.15.106:0/4024363773 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7638018070 con 0x7f764413cc00 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7644142920 con 0x7f764413cc00 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f762b7fe640 1 -- 172.21.15.106:0/4024363773 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763800fce0 con 0x7f764413cc00 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.198+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7644144a00 con 0x7f764413cc00 2024-04-16T12:57:39.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.199+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7644140720 con 0x7f764413cc00 2024-04-16T12:57:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.200+0000 7f762b7fe640 1 -- 172.21.15.106:0/4024363773 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f763801d460 con 0x7f764413cc00 2024-04-16T12:57:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.200+0000 7f762b7fe640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f763006c920 0x7f763006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.200+0000 7f762b7fe640 1 -- 172.21.15.106:0/4024363773 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f763808bc20 con 0x7f764413cc00 2024-04-16T12:57:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.200+0000 7f7642ffd640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f763006c920 0x7f763006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.201+0000 7f7642ffd640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f763006c920 0x7f763006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76441db170 tx=0x7f763400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.205+0000 7f762b7fe640 1 -- 172.21.15.106:0/4024363773 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7644140720 con 0x7f764413cc00 2024-04-16T12:57:39.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.378+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7644143210 con 0x7f764413cc00 2024-04-16T12:57:39.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.378+0000 7f762b7fe640 1 -- 172.21.15.106:0/4024363773 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7644143210 con 0x7f764413cc00 2024-04-16T12:57:39.380 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:39.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f763006c920 msgr2=0x7f763006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f763006c920 0x7f763006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76441db170 tx=0x7f763400b040 comp rx=0 tx=0).stop 2024-04-16T12:57:39.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f764413cc00 msgr2=0x7f76441e0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f764413cc00 0x7f76441e0cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7638007340 tx=0x7f7638007800 comp rx=0 tx=0).stop 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 shutdown_connections 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f763006c920 0x7f763006ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441e1230 0x7f76441dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f764413cc00 0x7f76441e0cf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 --2- 172.21.15.106:0/4024363773 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762c004ef0 0x7f764413c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 >> 172.21.15.106:0/4024363773 conn(0x7f76440ba460 msgr2=0x7f764413ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 shutdown_connections 2024-04-16T12:57:39.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.380+0000 7f7649441640 1 -- 172.21.15.106:0/4024363773 wait complete. 2024-04-16T12:57:39.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:39.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.497+0000 7fad75d52640 1 Processor -- start 2024-04-16T12:57:39.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad75d52640 1 -- start start 2024-04-16T12:57:39.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad75d52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad70145b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad75d52640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad7013fbb0 0x7fad701460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad75d52640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad700b56c0 con 0x7fad700b2900 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad75d52640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fad700b3c80 con 0x7fad7013fbb0 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad75d52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad700b39a0 con 0x7fad700b52e0 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad6ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad7013fbb0 0x7fad701460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad6ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad7013fbb0 0x7fad701460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33334/0 (socket says 172.21.15.106:33334) 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad6ffff640 1 -- 172.21.15.106:0/2341464427 learned_addr learned my addr 172.21.15.106:0/2341464427 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.498+0000 7fad6f7fe640 1 --2- 172.21.15.106:0/2341464427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad70145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.499+0000 7fad6ffff640 1 -- 172.21.15.106:0/2341464427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 msgr2=0x7fad70145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.499+0000 7fad6ffff640 1 --2- 172.21.15.106:0/2341464427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad70145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.499+0000 7fad6ffff640 1 -- 172.21.15.106:0/2341464427 >> v1:172.21.15.171:6789/0 conn(0x7fad700b2900 legacy=0x7fad7013f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.499+0000 7fad6ffff640 1 -- 172.21.15.106:0/2341464427 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad700b4480 con 0x7fad7013fbb0 2024-04-16T12:57:39.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.499+0000 7fad6ffff640 1 --2- 172.21.15.106:0/2341464427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701460d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad68009870 tx=0x7fad6802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324e4e8a9cd44a6f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.499+0000 7fad6e7fc640 1 -- 172.21.15.106:0/2341464427 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68034070 con 0x7fad7013fbb0 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad6e7fc640 1 -- 172.21.15.106:0/2341464427 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad68030840 con 0x7fad7013fbb0 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad6e7fc640 1 -- 172.21.15.106:0/2341464427 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68030c10 con 0x7fad7013fbb0 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 -- 172.21.15.106:0/2341464427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 msgr2=0x7fad701460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 --2- 172.21.15.106:0/2341464427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701460d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad68009870 tx=0x7fad6802b980 comp rx=0 tx=0).stop 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 -- 172.21.15.106:0/2341464427 shutdown_connections 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 --2- 172.21.15.106:0/2341464427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701460d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 --2- 172.21.15.106:0/2341464427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad70145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 -- 172.21.15.106:0/2341464427 >> 172.21.15.106:0/2341464427 conn(0x7fad700bb400 msgr2=0x7fad700bb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 -- 172.21.15.106:0/2341464427 shutdown_connections 2024-04-16T12:57:39.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.500+0000 7fad75d52640 1 -- 172.21.15.106:0/2341464427 wait complete. 2024-04-16T12:57:39.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.501+0000 7fad75d52640 1 Processor -- start 2024-04-16T12:57:39.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.501+0000 7fad75d52640 1 -- start start 2024-04-16T12:57:39.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad75d52640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad700b2900 0x7fad70148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad75d52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad701db8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad75d52640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701dbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad75d52640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad700b4110 con 0x7fad7013fbb0 2024-04-16T12:57:39.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad75d52640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad700b4a40 con 0x7fad700b2900 2024-04-16T12:57:39.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad75d52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad701503a0 con 0x7fad700b52e0 2024-04-16T12:57:39.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701dbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701dbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33340/0 (socket says 172.21.15.106:33340) 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 -- 172.21.15.106:0/2610246266 learned_addr learned my addr 172.21.15.106:0/2610246266 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6f7fe640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad700b2900 0x7fad70148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6effd640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad701db8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 -- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 msgr2=0x7fad701db8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad701db8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 -- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad700b2900 msgr2=0x7fad70148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad700b2900 0x7fad70148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 -- 172.21.15.106:0/2610246266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad70147820 con 0x7fad7013fbb0 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6effd640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad701db8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.502+0000 7fad6ffff640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701dbe20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad680090b0 tx=0x7fad680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.503+0000 7fad57fff640 1 -- 172.21.15.106:0/2610246266 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68034040 con 0x7fad7013fbb0 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.503+0000 7fad57fff640 1 -- 172.21.15.106:0/2610246266 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6803ada0 con 0x7fad7013fbb0 2024-04-16T12:57:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.503+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad70149400 con 0x7fad7013fbb0 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.503+0000 7fad57fff640 1 -- 172.21.15.106:0/2610246266 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68044630 con 0x7fad7013fbb0 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.503+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad70140840 con 0x7fad7013fbb0 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.504+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad701495d0 con 0x7fad7013fbb0 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.504+0000 7fad57fff640 1 -- 172.21.15.106:0/2610246266 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad68037070 con 0x7fad7013fbb0 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.505+0000 7fad57fff640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad5c06c8f0 0x7fad5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.505+0000 7fad6f7fe640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad5c06c8f0 0x7fad5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.505+0000 7fad57fff640 1 -- 172.21.15.106:0/2610246266 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fad680adb20 con 0x7fad7013fbb0 2024-04-16T12:57:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.505+0000 7fad6f7fe640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad5c06c8f0 0x7fad5c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad7013ebb0 tx=0x7fad600098d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.509+0000 7fad57fff640 1 -- 172.21.15.106:0/2610246266 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad701495d0 con 0x7fad7013fbb0 2024-04-16T12:57:39.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.682+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fad70144510 con 0x7fad7013fbb0 2024-04-16T12:57:39.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.683+0000 7fad57fff640 1 -- 172.21.15.106:0/2610246266 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fad6803f070 con 0x7fad7013fbb0 2024-04-16T12:57:39.684 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.684+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad5c06c8f0 msgr2=0x7fad5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.684+0000 7fad75d52640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad5c06c8f0 0x7fad5c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad7013ebb0 tx=0x7fad600098d0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.684+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 msgr2=0x7fad701dbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.684+0000 7fad75d52640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701dbe20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad680090b0 tx=0x7fad680046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.684+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 shutdown_connections 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.684+0000 7fad75d52640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad5c06c8f0 0x7fad5c06edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.685+0000 7fad75d52640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad7013fbb0 0x7fad701dbe20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.685+0000 7fad75d52640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad700b52e0 0x7fad701db8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.685+0000 7fad75d52640 1 --2- 172.21.15.106:0/2610246266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad700b2900 0x7fad70148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.685+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 >> 172.21.15.106:0/2610246266 conn(0x7fad700bb400 msgr2=0x7fad70143990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.685+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 shutdown_connections 2024-04-16T12:57:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.685+0000 7fad75d52640 1 -- 172.21.15.106:0/2610246266 wait complete. 2024-04-16T12:57:39.697 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-04-16T12:57:39.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.799+0000 7f0a0a1a1640 1 Processor -- start 2024-04-16T12:57:39.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.799+0000 7f0a0a1a1640 1 -- start start 2024-04-16T12:57:39.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.799+0000 7f0a0a1a1640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a040b7dd0 0x7f0a0409b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.799+0000 7f0a0a1a1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04142070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.799+0000 7f0a0a1a1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0406c3d0 con 0x7f0a0406bff0 2024-04-16T12:57:39.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.799+0000 7f0a0a1a1640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0a0409c880 con 0x7f0a040b7dd0 2024-04-16T12:57:39.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.799+0000 7f0a0a1a1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a04147e60 con 0x7f0a04141bf0 2024-04-16T12:57:39.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a0899e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a040b7dd0 0x7f0a0409b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a099a0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a0919f640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0a0406bff0 0x7f0a04148660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:45352/0 (socket says 172.21.15.106:45352) 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a0919f640 1 -- 172.21.15.106:0/2317023311 learned_addr learned my addr 172.21.15.106:0/2317023311 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a0899e640 1 -- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 msgr2=0x7f0a04142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a0899e640 1 --2- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a0899e640 1 -- 172.21.15.106:0/2317023311 >> v1:172.21.15.171:6789/0 conn(0x7f0a0406bff0 legacy=0x7f0a04148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f09fbfff640 1 -- 172.21.15.106:0/2317023311 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424136733 0 0) 0x7f0a0406c3d0 con 0x7f0a0406bff0 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a0899e640 1 -- 172.21.15.106:0/2317023311 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a04148140 con 0x7f0a040b7dd0 2024-04-16T12:57:39.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.800+0000 7f0a099a0640 1 --2- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:39.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.801+0000 7f0a0899e640 1 --2- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a0409b430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09f40097a0 tx=0x7f09f402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39aeead4aebb9f0a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.801+0000 7f09fbfff640 1 -- 172.21.15.106:0/2317023311 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f40315a0 con 0x7f0a040b7dd0 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.801+0000 7f09fbfff640 1 -- 172.21.15.106:0/2317023311 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f4037070 con 0x7f0a040b7dd0 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.801+0000 7f09fbfff640 1 -- 172.21.15.106:0/2317023311 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4031960 con 0x7f0a040b7dd0 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 msgr2=0x7f0a0409b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a0409b430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09f40097a0 tx=0x7f09f402b840 comp rx=0 tx=0).stop 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/2317023311 shutdown_connections 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/2317023311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a0409b430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/2317023311 >> 172.21.15.106:0/2317023311 conn(0x7f0a040bd450 msgr2=0x7f0a040bd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/2317023311 shutdown_connections 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.802+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/2317023311 wait complete. 2024-04-16T12:57:39.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 Processor -- start 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 -- start start 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a0406bff0 0x7f0a040b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a041de120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04138510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0a04152670 con 0x7f0a0406bff0 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0a041524f0 con 0x7f0a040b7dd0 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0a1a1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a041527f0 con 0x7f0a04141bf0 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0919f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a0406bff0 0x7f0a040b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0919f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a0406bff0 0x7f0a040b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33348/0 (socket says 172.21.15.106:33348) 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.803+0000 7f0a0919f640 1 -- 172.21.15.106:0/3632891091 learned_addr learned my addr 172.21.15.106:0/3632891091 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0899e640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a041de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0919f640 1 -- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 msgr2=0x7f0a04138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a099a0640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0919f640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04138510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0919f640 1 -- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 msgr2=0x7f0a041de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0919f640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a041de120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0919f640 1 -- 172.21.15.106:0/3632891091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a041dd960 con 0x7f0a0406bff0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0899e640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a041de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0919f640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a0406bff0 0x7f0a040b4aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c4d0 tx=0x7f0a0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f09f9ffb640 1 -- 172.21.15.106:0/3632891091 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00018070 con 0x7f0a0406bff0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f09f9ffb640 1 -- 172.21.15.106:0/3632891091 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a00007500 con 0x7f0a0406bff0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0413c960 con 0x7f0a0406bff0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f09f9ffb640 1 -- 172.21.15.106:0/3632891091 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00004a20 con 0x7f0a0406bff0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.804+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a040b5f90 con 0x7f0a0406bff0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.805+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a04068a90 con 0x7f0a0406bff0 2024-04-16T12:57:39.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.806+0000 7f09f9ffb640 1 -- 172.21.15.106:0/3632891091 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a0001b070 con 0x7f0a0406bff0 2024-04-16T12:57:39.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.806+0000 7f09f9ffb640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f09e806c920 0x7f09e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:39.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.806+0000 7f09f9ffb640 1 -- 172.21.15.106:0/3632891091 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a0008ae40 con 0x7f0a0406bff0 2024-04-16T12:57:39.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.806+0000 7f0a0899e640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f09e806c920 0x7f09e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:39.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.807+0000 7f0a0899e640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f09e806c920 0x7f09e806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09f4036000 tx=0x7f09f4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:39.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:39.810+0000 7f09f9ffb640 1 -- 172.21.15.106:0/3632891091 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a00059270 con 0x7f0a0406bff0 2024-04-16T12:57:40.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.053+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) -- 0x7f0a0409acc0 con 0x7f0a0406bff0 2024-04-16T12:57:40.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.948+0000 7f09f9ffb640 1 -- 172.21.15.106:0/3632891091 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v44) ==== 137+0+0 (secure 0 0 0) 0x7f0a00058b70 con 0x7f0a0406bff0 2024-04-16T12:57:40.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f09e806c920 msgr2=0x7f09e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:40.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f09e806c920 0x7f09e806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09f4036000 tx=0x7f09f4008030 comp rx=0 tx=0).stop 2024-04-16T12:57:40.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a0406bff0 msgr2=0x7f0a040b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:40.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a0406bff0 0x7f0a040b4aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c4d0 tx=0x7f0a0000c990 comp rx=0 tx=0).stop 2024-04-16T12:57:40.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 shutdown_connections 2024-04-16T12:57:40.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f09e806c920 0x7f09e806ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:40.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a04141bf0 0x7f0a04138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:40.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a040b7dd0 0x7f0a041de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:40.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 --2- 172.21.15.106:0/3632891091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a0406bff0 0x7f0a040b4aa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:40.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 >> 172.21.15.106:0/3632891091 conn(0x7f0a040bd450 msgr2=0x7f0a04140fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:40.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 shutdown_connections 2024-04-16T12:57:40.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:40.951+0000 7f0a0a1a1640 1 -- 172.21.15.106:0/3632891091 wait complete. 2024-04-16T12:57:40.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T12:57:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.076+0000 7efc1ab82640 1 Processor -- start 2024-04-16T12:57:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.076+0000 7efc1ab82640 1 -- start start 2024-04-16T12:57:41.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.076+0000 7efc1ab82640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efc140b63e0 0x7efc140b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.076+0000 7efc1ab82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc14142140 0x7efc141526c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.076+0000 7efc1ab82640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc140b67c0 con 0x7efc141486a0 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.076+0000 7efc1ab82640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efc140b7610 con 0x7efc140b63e0 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.076+0000 7efc1ab82640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc140b5660 con 0x7efc14142140 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc13fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efc141486a0 0x7efc14141a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59512/0 (socket says 172.21.15.106:59512) 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc13fff640 1 -- 172.21.15.106:0/4062103430 learned_addr learned my addr 172.21.15.106:0/4062103430 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc1891e640 1 --2- 172.21.15.106:0/4062103430 >> v2:172.21.15.171:3300/0 conn(0x7efc140b63e0 0x7efc140b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc1911f640 1 --2- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc14142140 0x7efc141526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc137fe640 1 -- 172.21.15.106:0/4062103430 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871851689 0 0) 0x7efc140b67c0 con 0x7efc141486a0 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc137fe640 1 -- 172.21.15.106:0/4062103430 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc00003520 con 0x7efc141486a0 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc1891e640 1 -- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc14142140 msgr2=0x7efc141526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc1891e640 1 --2- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc14142140 0x7efc141526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc1891e640 1 -- 172.21.15.106:0/4062103430 >> v1:172.21.15.106:6789/0 conn(0x7efc141486a0 legacy=0x7efc14141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc1891e640 1 -- 172.21.15.106:0/4062103430 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc140b59a0 con 0x7efc140b63e0 2024-04-16T12:57:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.077+0000 7efc1911f640 1 --2- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc14142140 0x7efc141526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.078+0000 7efc1891e640 1 --2- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc140b6f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097a0 tx=0x7efbfc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdda4da036d6b3e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.078+0000 7efc137fe640 1 -- 172.21.15.106:0/4062103430 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc035020 con 0x7efc140b63e0 2024-04-16T12:57:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.078+0000 7efc137fe640 1 -- 172.21.15.106:0/4062103430 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc031810 con 0x7efc140b63e0 2024-04-16T12:57:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.078+0000 7efc137fe640 1 -- 172.21.15.106:0/4062103430 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc031bc0 con 0x7efc140b63e0 2024-04-16T12:57:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 -- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 msgr2=0x7efc140b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc140b6f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097a0 tx=0x7efbfc02b8b0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 -- 172.21.15.106:0/4062103430 shutdown_connections 2024-04-16T12:57:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc14142140 0x7efc141526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4062103430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc140b6f00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 -- 172.21.15.106:0/4062103430 >> 172.21.15.106:0/4062103430 conn(0x7efc140bd640 msgr2=0x7efc140bda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 -- 172.21.15.106:0/4062103430 shutdown_connections 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.079+0000 7efc1ab82640 1 -- 172.21.15.106:0/4062103430 wait complete. 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 Processor -- start 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 -- start start 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc14144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc14142140 0x7efc141e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc141486a0 0x7efc141e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efc140b7fc0 con 0x7efc14142140 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc14148d20 con 0x7efc140b63e0 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.080+0000 7efc1ab82640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc140b8140 con 0x7efc141486a0 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc14142140 0x7efc141e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc14142140 0x7efc141e11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33354/0 (socket says 172.21.15.106:33354) 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 -- 172.21.15.106:0/4182086398 learned_addr learned my addr 172.21.15.106:0/4182086398 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc1891e640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc14144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc1911f640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc141486a0 0x7efc141e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 -- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc141486a0 msgr2=0x7efc141e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc141486a0 0x7efc141e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 -- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 msgr2=0x7efc14144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc14144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 -- 172.21.15.106:0/4182086398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1414be70 con 0x7efc14142140 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc1891e640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc14144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc13fff640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc14142140 0x7efc141e11d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc0400cad0 tx=0x7efc0400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc117fa640 1 -- 172.21.15.106:0/4182086398 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04017070 con 0x7efc14142140 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc117fa640 1 -- 172.21.15.106:0/4182086398 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0400ac30 con 0x7efc14142140 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc141e0cb0 con 0x7efc14142140 2024-04-16T12:57:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc117fa640 1 -- 172.21.15.106:0/4182086398 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04012400 con 0x7efc14142140 2024-04-16T12:57:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.081+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc14144fa0 con 0x7efc14142140 2024-04-16T12:57:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.082+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc141e0eb0 con 0x7efc14142140 2024-04-16T12:57:41.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.083+0000 7efc117fa640 1 -- 172.21.15.106:0/4182086398 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc0401a070 con 0x7efc14142140 2024-04-16T12:57:41.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.083+0000 7efc117fa640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7efbf406c8f0 0x7efbf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.083+0000 7efc117fa640 1 -- 172.21.15.106:0/4182086398 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efc0408b870 con 0x7efc14142140 2024-04-16T12:57:41.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.083+0000 7efc1891e640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7efbf406c8f0 0x7efbf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.084+0000 7efc1891e640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7efbf406c8f0 0x7efbf406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efbfc036000 tx=0x7efbfc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.088+0000 7efc117fa640 1 -- 172.21.15.106:0/4182086398 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc141e0eb0 con 0x7efc14142140 2024-04-16T12:57:41.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.264+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efc1413d1e0 con 0x7efc14142140 2024-04-16T12:57:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.269+0000 7efc117fa640 1 -- 172.21.15.106:0/4182086398 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7efc04059d30 con 0x7efc14142140 2024-04-16T12:57:41.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7efbf406c8f0 msgr2=0x7efbf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7efbf406c8f0 0x7efbf406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efbfc036000 tx=0x7efbfc008030 comp rx=0 tx=0).stop 2024-04-16T12:57:41.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc14142140 msgr2=0x7efc141e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc14142140 0x7efc141e11d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc0400cad0 tx=0x7efc0400cf90 comp rx=0 tx=0).stop 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 shutdown_connections 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7efbf406c8f0 0x7efbf406edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc141486a0 0x7efc141e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc14142140 0x7efc141e11d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 --2- 172.21.15.106:0/4182086398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc140b63e0 0x7efc14144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 >> 172.21.15.106:0/4182086398 conn(0x7efc140bd640 msgr2=0x7efc14141800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 shutdown_connections 2024-04-16T12:57:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.272+0000 7efc1ab82640 1 -- 172.21.15.106:0/4182086398 wait complete. 2024-04-16T12:57:41.284 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T12:57:41.284 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T12:57:41.322 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T12:57:41.442 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T12:57:41.443 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:57:41.443 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:57:41.459 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:57:41.459 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:57:41.516 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:41.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.656+0000 7f87a387e640 1 Processor -- start 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.657+0000 7f87a387e640 1 -- start start 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.657+0000 7f87a387e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f879c0b53d0 0x7f879c0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.657+0000 7f87a387e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c1488d0 con 0x7f879c0b6780 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.657+0000 7f87a387e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c0b5d40 con 0x7f879c0b63a0 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.657+0000 7f87a387e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f879c148b70 con 0x7f879c0b53d0 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.657+0000 7f87a0e19640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f879c0b6780 0x7f879c1418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59524/0 (socket says 172.21.15.106:59524) 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.657+0000 7f87a0e19640 1 -- 172.21.15.106:0/2117458348 learned_addr learned my addr 172.21.15.106:0/2117458348 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a1e1b640 1 --2- 172.21.15.106:0/2117458348 >> v2:172.21.15.171:3300/0 conn(0x7f879c0b53d0 0x7f879c0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891720642 0 0) 0x7f879c1488d0 con 0x7f879c0b6780 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8788003520 con 0x7f879c0b6780 2024-04-16T12:57:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3740310919 0 0) 0x7f8788003520 con 0x7f879c0b6780 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 >> v2:172.21.15.171:3300/0 conn(0x7f879c0b53d0 msgr2=0x7f879c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 --2- 172.21.15.106:0/2117458348 >> v2:172.21.15.171:3300/0 conn(0x7f879c0b53d0 0x7f879c0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 >> v1:172.21.15.171:6789/0 conn(0x7f879c0b63a0 legacy=0x7f879c1481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c0b4bd0 con 0x7f879c0b6780 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f8798001690 con 0x7f879c0b6780 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 >> v1:172.21.15.106:6789/0 conn(0x7f879c0b6780 legacy=0x7f879c1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87880039b0 0x7f8788003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8788004800 0x7f8788004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f878800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f879c148b70 con 0x7f87880051c0 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f878800c160 con 0x7f8788004800 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f878800c360 con 0x7f87880039b0 2024-04-16T12:57:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a0e19640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8788004800 0x7f8788004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a1e1b640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f878800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a161a640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87880039b0 0x7f8788003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a1e1b640 1 -- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87880039b0 msgr2=0x7f8788003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a1e1b640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87880039b0 0x7f8788003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a1e1b640 1 -- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8788004800 msgr2=0x7f8788004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a1e1b640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8788004800 0x7f8788004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a1e1b640 1 -- 172.21.15.106:0/2117458348 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8788003520 con 0x7f87880051c0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.658+0000 7f87a0e19640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8788004800 0x7f8788004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.659+0000 7f87a1e1b640 1 -- 172.21.15.106:0/2117458348 reap_dead start 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.659+0000 7f87a1e1b640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f878800b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8794009fc0 tx=0x7f8788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc46bb1e3e35d2b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.659+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798007d30 con 0x7f87880051c0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.659+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879402cca0 con 0x7f87880051c0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.659+0000 7f878ffff640 1 -- 172.21.15.106:0/2117458348 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794009c10 con 0x7f87880051c0 2024-04-16T12:57:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.660+0000 7f87a387e640 1 -- 172.21.15.106:0/2117458348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 msgr2=0x7f878800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.660+0000 7f87a387e640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f878800b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8794009fc0 tx=0x7f8788005830 comp rx=0 tx=0).stop 2024-04-16T12:57:41.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.660+0000 7f87a387e640 1 -- 172.21.15.106:0/2117458348 shutdown_connections 2024-04-16T12:57:41.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.660+0000 7f87a387e640 1 --2- 172.21.15.106:0/2117458348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f878800b9c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.660+0000 7f87a387e640 1 -- 172.21.15.106:0/2117458348 >> 172.21.15.106:0/2117458348 conn(0x7f879c068080 msgr2=0x7f879c0bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:41.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.660+0000 7f87a387e640 1 -- 172.21.15.106:0/2117458348 shutdown_connections 2024-04-16T12:57:41.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.660+0000 7f87a387e640 1 -- 172.21.15.106:0/2117458348 wait complete. 2024-04-16T12:57:41.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 Processor -- start 2024-04-16T12:57:41.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 -- start start 2024-04-16T12:57:41.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f879c14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879c0a9bf0 0x7f879c0aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f879c1e0bc0 0x7f879c1e1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0b5980 con 0x7f87880051c0 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0b5800 con 0x7f879c1e0bc0 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.661+0000 7f87a387e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f879c0b5b00 con 0x7f879c0a9bf0 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f879c14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f879c14b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33364/0 (socket says 172.21.15.106:33364) 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 -- 172.21.15.106:0/1495997846 learned_addr learned my addr 172.21.15.106:0/1495997846 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a1e1b640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f879c1e0bc0 0x7f879c1e1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 -- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879c0a9bf0 msgr2=0x7f879c0aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a0e19640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879c0a9bf0 0x7f879c0aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879c0a9bf0 0x7f879c0aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 -- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f879c1e0bc0 msgr2=0x7f879c1e1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f879c1e0bc0 0x7f879c1e1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 -- 172.21.15.106:0/1495997846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c0aa570 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a1e1b640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f879c1e0bc0 0x7f879c1e1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a161a640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f879c14b4a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f879000f620 tx=0x7f879000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f878dffb640 1 -- 172.21.15.106:0/1495997846 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87900052e0 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f878dffb640 1 -- 172.21.15.106:0/1495997846 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790018070 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c0ac3c0 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f878dffb640 1 -- 172.21.15.106:0/1495997846 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790003810 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.662+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c14bd80 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.663+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c068a90 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.664+0000 7f878dffb640 1 -- 172.21.15.106:0/1495997846 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87900039b0 con 0x7f87880051c0 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.664+0000 7f878dffb640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f878006c8f0 0x7f878006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.664+0000 7f878dffb640 1 -- 172.21.15.106:0/1495997846 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f879008b8d0 con 0x7f87880051c0 2024-04-16T12:57:41.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.664+0000 7f87a0e19640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f878006c8f0 0x7f878006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.665+0000 7f87a0e19640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f878006c8f0 0x7f878006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8798000ff0 tx=0x7f8798009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.668+0000 7f878dffb640 1 -- 172.21.15.106:0/1495997846 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f879c0aa570 con 0x7f87880051c0 2024-04-16T12:57:41.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.846+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f879c0adfb0 con 0x7f87880051c0 2024-04-16T12:57:41.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.847+0000 7f878dffb640 1 -- 172.21.15.106:0/1495997846 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f8790059d90 con 0x7f87880051c0 2024-04-16T12:57:41.848 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:41.849 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:41.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f878006c8f0 msgr2=0x7f878006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f878006c8f0 0x7f878006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8798000ff0 tx=0x7f8798009040 comp rx=0 tx=0).stop 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 msgr2=0x7f879c14b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f879c14b4a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f879000f620 tx=0x7f879000fae0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 shutdown_connections 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f878006c8f0 0x7f878006edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f879c1e0bc0 0x7f879c1e1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879c0a9bf0 0x7f879c0aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 --2- 172.21.15.106:0/1495997846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880051c0 0x7f879c14b4a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 >> 172.21.15.106:0/1495997846 conn(0x7f879c068080 msgr2=0x7f879c0ba630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 shutdown_connections 2024-04-16T12:57:41.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.849+0000 7f87a387e640 1 -- 172.21.15.106:0/1495997846 wait complete. 2024-04-16T12:57:41.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:41.862 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:41.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.970+0000 7f1d2e8c8640 1 Processor -- start 2024-04-16T12:57:41.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.970+0000 7f1d2e8c8640 1 -- start start 2024-04-16T12:57:41.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.970+0000 7f1d2e8c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28072d10 0x7f1d28072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.970+0000 7f1d2e8c8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1d2813e7a0 0x7f1d2813ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.970+0000 7f1d2e8c8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d280730f0 con 0x7f1d280baf70 2024-04-16T12:57:41.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.970+0000 7f1d2e8c8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1d280714b0 con 0x7f1d2813e7a0 2024-04-16T12:57:41.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.970+0000 7f1d2e8c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1d28071790 con 0x7f1d28072d10 2024-04-16T12:57:41.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d27fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28072d10 0x7f1d28072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d2ce65640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1d2813e7a0 0x7f1d2813ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d27fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28072d10 0x7f1d28072190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:48216/0 (socket says 172.21.15.106:48216) 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d27fff640 1 -- 172.21.15.106:0/4213491010 learned_addr learned my addr 172.21.15.106:0/4213491010 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d277fe640 1 -- 172.21.15.106:0/4213491010 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63984153 0 0) 0x7f1d280730f0 con 0x7f1d280baf70 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d277fe640 1 -- 172.21.15.106:0/4213491010 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d14003520 con 0x7f1d280baf70 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d27fff640 1 -- 172.21.15.106:0/4213491010 >> v2:172.21.15.171:3300/0 conn(0x7f1d2813e7a0 msgr2=0x7f1d2813ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d27fff640 1 --2- 172.21.15.106:0/4213491010 >> v2:172.21.15.171:3300/0 conn(0x7f1d2813e7a0 0x7f1d2813ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d27fff640 1 -- 172.21.15.106:0/4213491010 >> v1:172.21.15.171:6789/0 conn(0x7f1d280baf70 legacy=0x7f1d280b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d27fff640 1 -- 172.21.15.106:0/4213491010 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2813f150 con 0x7f1d28072d10 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.971+0000 7f1d2ce65640 1 --2- 172.21.15.106:0/4213491010 >> v2:172.21.15.171:3300/0 conn(0x7f1d2813e7a0 0x7f1d2813ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.972+0000 7f1d27fff640 1 --2- 172.21.15.106:0/4213491010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28072d10 0x7f1d28072190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009870 tx=0x7f1d1802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2b7e07321155b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.972+0000 7f1d277fe640 1 -- 172.21.15.106:0/4213491010 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18035020 con 0x7f1d28072d10 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.972+0000 7f1d277fe640 1 -- 172.21.15.106:0/4213491010 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d18031640 con 0x7f1d28072d10 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.972+0000 7f1d277fe640 1 -- 172.21.15.106:0/4213491010 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1802d040 con 0x7f1d28072d10 2024-04-16T12:57:41.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/4213491010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28072d10 msgr2=0x7f1d28072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/4213491010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28072d10 0x7f1d28072190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009870 tx=0x7f1d1802b8f0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/4213491010 shutdown_connections 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/4213491010 >> v2:172.21.15.171:3300/0 conn(0x7f1d2813e7a0 0x7f1d2813ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/4213491010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28072d10 0x7f1d28072190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/4213491010 >> 172.21.15.106:0/4213491010 conn(0x7f1d2806d200 msgr2=0x7f1d280ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/4213491010 shutdown_connections 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.973+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/4213491010 wait complete. 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 Processor -- start 2024-04-16T12:57:41.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 -- start start 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d28072d10 0x7f1d28147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d2813e7a0 0x7f1d28138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28144fa0 0x7f1d281dee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1d280b47b0 con 0x7f1d2813e7a0 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d280b4630 con 0x7f1d28072d10 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2e8c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2814f320 con 0x7f1d28144fa0 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d1ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d2813e7a0 0x7f1d28138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d1ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d2813e7a0 0x7f1d28138d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33376/0 (socket says 172.21.15.106:33376) 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d1ffff640 1 -- 172.21.15.106:0/2334831872 learned_addr learned my addr 172.21.15.106:0/2334831872 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.974+0000 7f1d2ce65640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28144fa0 0x7f1d281dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d27fff640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d28072d10 0x7f1d28147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d1ffff640 1 -- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28144fa0 msgr2=0x7f1d281dee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d1ffff640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28144fa0 0x7f1d281dee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d1ffff640 1 -- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d28072d10 msgr2=0x7f1d28147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d1ffff640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d28072d10 0x7f1d28147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d1ffff640 1 -- 172.21.15.106:0/2334831872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2813a430 con 0x7f1d2813e7a0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d2ce65640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28144fa0 0x7f1d281dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d27fff640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d28072d10 0x7f1d28147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d1ffff640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d2813e7a0 0x7f1d28138d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c530 tx=0x7f1d1000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d257fa640 1 -- 172.21.15.106:0/2334831872 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100052d0 con 0x7f1d2813e7a0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d257fa640 1 -- 172.21.15.106:0/2334831872 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10005490 con 0x7f1d2813e7a0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d28145430 con 0x7f1d2813e7a0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d257fa640 1 -- 172.21.15.106:0/2334831872 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10012870 con 0x7f1d2813e7a0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.975+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d281392d0 con 0x7f1d2813e7a0 2024-04-16T12:57:41.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.976+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d280691a0 con 0x7f1d2813e7a0 2024-04-16T12:57:41.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.977+0000 7f1d257fa640 1 -- 172.21.15.106:0/2334831872 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d10012a10 con 0x7f1d2813e7a0 2024-04-16T12:57:41.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.977+0000 7f1d257fa640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d0806c8f0 0x7f1d0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:41.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.977+0000 7f1d257fa640 1 -- 172.21.15.106:0/2334831872 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d1008b840 con 0x7f1d2813e7a0 2024-04-16T12:57:41.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.977+0000 7f1d27fff640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d0806c8f0 0x7f1d0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:41.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.977+0000 7f1d27fff640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d0806c8f0 0x7f1d0806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d18036000 tx=0x7f1d1803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:41.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:41.981+0000 7f1d257fa640 1 -- 172.21.15.106:0/2334831872 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d10059c80 con 0x7f1d2813e7a0 2024-04-16T12:57:42.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.155+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1d280b7610 con 0x7f1d2813e7a0 2024-04-16T12:57:42.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.155+0000 7f1d257fa640 1 -- 172.21.15.106:0/2334831872 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1d10059580 con 0x7f1d2813e7a0 2024-04-16T12:57:42.157 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d0806c8f0 msgr2=0x7f1d0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d0806c8f0 0x7f1d0806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d18036000 tx=0x7f1d1803c040 comp rx=0 tx=0).stop 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d2813e7a0 msgr2=0x7f1d28138d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d2813e7a0 0x7f1d28138d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c530 tx=0x7f1d1000c9f0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 shutdown_connections 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d0806c8f0 0x7f1d0806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d28144fa0 0x7f1d281dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d2813e7a0 0x7f1d28138d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 --2- 172.21.15.106:0/2334831872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d28072d10 0x7f1d28147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 >> 172.21.15.106:0/2334831872 conn(0x7f1d2806d200 msgr2=0x7f1d2806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:42.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 shutdown_connections 2024-04-16T12:57:42.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.157+0000 7f1d2e8c8640 1 -- 172.21.15.106:0/2334831872 wait complete. 2024-04-16T12:57:42.170 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:42.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.274+0000 7fad5588f640 1 Processor -- start 2024-04-16T12:57:42.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad5588f640 1 -- start start 2024-04-16T12:57:42.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad5588f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fad500bdf90 0x7fad5014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad5588f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 0x7fad5014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad5588f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad500be370 con 0x7fad50141c20 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad5588f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fad500b5200 con 0x7fad500bdf90 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad5588f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad500b7930 con 0x7fad500b66c0 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad4f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fad50141c20 0x7fad501420b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59534/0 (socket says 172.21.15.106:59534) 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad4f7fe640 1 -- 172.21.15.106:0/2548059124 learned_addr learned my addr 172.21.15.106:0/2548059124 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.275+0000 7fad4e7fc640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 0x7fad5014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4effd640 1 --2- 172.21.15.106:0/2548059124 >> v2:172.21.15.171:3300/0 conn(0x7fad500bdf90 0x7fad5014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883765073 0 0) 0x7fad500be370 con 0x7fad50141c20 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad3c003520 con 0x7fad50141c20 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2972419368 0 0) 0x7fad3c003520 con 0x7fad50141c20 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 msgr2=0x7fad5014ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 0x7fad5014ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 >> v2:172.21.15.171:3300/0 conn(0x7fad500bdf90 msgr2=0x7fad5014b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 --2- 172.21.15.106:0/2548059124 >> v2:172.21.15.171:3300/0 conn(0x7fad500bdf90 0x7fad5014b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad500b7650 con 0x7fad50141c20 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fad48001670 con 0x7fad50141c20 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 >> v1:172.21.15.106:6789/0 conn(0x7fad50141c20 legacy=0x7fad501420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 0x7fad3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad3c004d40 0x7fad3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad500b5200 con 0x7fad3c0039b0 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad500b7930 con 0x7fad3c004d40 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad3c00b9c0 con 0x7fad500b66c0 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4effd640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4f7fe640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad3c004d40 0x7fad3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4e7fc640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 0x7fad3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4effd640 1 -- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 msgr2=0x7fad3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4effd640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 0x7fad3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4effd640 1 -- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad3c004d40 msgr2=0x7fad3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4effd640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad3c004d40 0x7fad3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4effd640 1 -- 172.21.15.106:0/2548059124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c003520 con 0x7fad3c0039b0 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.276+0000 7fad4e7fc640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad500b66c0 0x7fad3c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.277+0000 7fad4effd640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad3c003dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fc0 tx=0x7fad3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30288454a7a5d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.277+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40039070 con 0x7fad3c0039b0 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.277+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4002cc60 con 0x7fad3c0039b0 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.277+0000 7fad4dffb640 1 -- 172.21.15.106:0/2548059124 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40009c10 con 0x7fad3c0039b0 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.278+0000 7fad5588f640 1 -- 172.21.15.106:0/2548059124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 msgr2=0x7fad3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.278+0000 7fad5588f640 1 --2- 172.21.15.106:0/2548059124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad3c003dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fc0 tx=0x7fad3c005830 comp rx=0 tx=0).stop 2024-04-16T12:57:42.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.278+0000 7fad4f7fe640 1 -- 172.21.15.106:0/2548059124 reap_dead start 2024-04-16T12:57:42.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.278+0000 7fad5588f640 1 -- 172.21.15.106:0/2548059124 shutdown_connections 2024-04-16T12:57:42.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.278+0000 7fad5588f640 1 -- 172.21.15.106:0/2548059124 >> 172.21.15.106:0/2548059124 conn(0x7fad50067e70 msgr2=0x7fad500bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:42.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.278+0000 7fad5588f640 1 -- 172.21.15.106:0/2548059124 shutdown_connections 2024-04-16T12:57:42.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.278+0000 7fad5588f640 1 -- 172.21.15.106:0/2548059124 wait complete. 2024-04-16T12:57:42.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 Processor -- start 2024-04-16T12:57:42.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 -- start start 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad501d3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad501d1be0 0x7fad501d2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad501428f0 0x7fad50142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad500b55d0 con 0x7fad3c0039b0 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad500b4e90 con 0x7fad501d1be0 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.279+0000 7fad5588f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad500b5750 con 0x7fad501428f0 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad501d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad501d3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33394/0 (socket says 172.21.15.106:33394) 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 -- 172.21.15.106:0/3974570212 learned_addr learned my addr 172.21.15.106:0/3974570212 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4f7fe640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad501428f0 0x7fad50142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4e7fc640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad501d1be0 0x7fad501d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 -- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad501428f0 msgr2=0x7fad50142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad501428f0 0x7fad50142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 -- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad501d1be0 msgr2=0x7fad501d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad501d1be0 0x7fad501d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 -- 172.21.15.106:0/3974570212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad500b0cc0 con 0x7fad3c0039b0 2024-04-16T12:57:42.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad4effd640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad501d3270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad40037040 tx=0x7fad40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad47fff640 1 -- 172.21.15.106:0/3974570212 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40039050 con 0x7fad3c0039b0 2024-04-16T12:57:42.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad47fff640 1 -- 172.21.15.106:0/3974570212 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4003a040 con 0x7fad3c0039b0 2024-04-16T12:57:42.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad501432b0 con 0x7fad3c0039b0 2024-04-16T12:57:42.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad47fff640 1 -- 172.21.15.106:0/3974570212 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40009c10 con 0x7fad3c0039b0 2024-04-16T12:57:42.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.280+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad501d2800 con 0x7fad3c0039b0 2024-04-16T12:57:42.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.281+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad50068a90 con 0x7fad3c0039b0 2024-04-16T12:57:42.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.282+0000 7fad47fff640 1 -- 172.21.15.106:0/3974570212 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad40047030 con 0x7fad3c0039b0 2024-04-16T12:57:42.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.282+0000 7fad47fff640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad3006c8f0 0x7fad3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.282+0000 7fad47fff640 1 -- 172.21.15.106:0/3974570212 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fad400adc70 con 0x7fad3c0039b0 2024-04-16T12:57:42.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.282+0000 7fad4e7fc640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad3006c8f0 0x7fad3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.283+0000 7fad4e7fc640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad3006c8f0 0x7fad3006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad501d3910 tx=0x7fad38008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.287+0000 7fad47fff640 1 -- 172.21.15.106:0/3974570212 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad4004e060 con 0x7fad3c0039b0 2024-04-16T12:57:42.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.462+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fad501416b0 con 0x7fad3c0039b0 2024-04-16T12:57:42.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.463+0000 7fad47fff640 1 -- 172.21.15.106:0/3974570212 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fad501432b0 con 0x7fad3c0039b0 2024-04-16T12:57:42.465 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:42.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad3006c8f0 msgr2=0x7fad3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad3006c8f0 0x7fad3006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad501d3910 tx=0x7fad38008040 comp rx=0 tx=0).stop 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 msgr2=0x7fad501d3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad501d3270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad40037040 tx=0x7fad40009750 comp rx=0 tx=0).stop 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 shutdown_connections 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fad3006c8f0 0x7fad3006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad501428f0 0x7fad50142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad501d1be0 0x7fad501d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 --2- 172.21.15.106:0/3974570212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad3c0039b0 0x7fad501d3270 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 >> 172.21.15.106:0/3974570212 conn(0x7fad50067e70 msgr2=0x7fad500b86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 shutdown_connections 2024-04-16T12:57:42.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.465+0000 7fad5588f640 1 -- 172.21.15.106:0/3974570212 wait complete. 2024-04-16T12:57:42.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:42.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.582+0000 7f0b04c60640 1 Processor -- start 2024-04-16T12:57:42.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.582+0000 7f0b04c60640 1 -- start start 2024-04-16T12:57:42.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0b04c60640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4280 0x7f0b00073c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0b04c60640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b0006b9b0 0x7f0b000b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0b04c60640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0006be00 con 0x7f0b000b4660 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0b04c60640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f0b00072da0 con 0x7f0b0006b9b0 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0b04c60640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b00073080 con 0x7f0b000b4280 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afed9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b0006b9b0 0x7f0b000b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afdd9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0b000b4660 0x7f0b000b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50710/0 (socket says 172.21.15.106:50710) 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afdd9b640 1 -- 172.21.15.106:0/2223690911 learned_addr learned my addr 172.21.15.106:0/2223690911 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afed9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b0006b9b0 0x7f0b000b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33588/0 (socket says 172.21.15.106:33588) 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afe59c640 1 --2- 172.21.15.106:0/2223690911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4280 0x7f0b00073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afed9d640 1 -- 172.21.15.106:0/2223690911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4280 msgr2=0x7f0b00073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afed9d640 1 --2- 172.21.15.106:0/2223690911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4280 0x7f0b00073c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afed9d640 1 -- 172.21.15.106:0/2223690911 >> v1:172.21.15.106:6789/0 conn(0x7f0b000b4660 legacy=0x7f0b000b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afed9d640 1 -- 172.21.15.106:0/2223690911 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b00073360 con 0x7f0b0006b9b0 2024-04-16T12:57:42.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afd59a640 1 -- 172.21.15.106:0/2223690911 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497800662 0 0) 0x7f0b0006be00 con 0x7f0b000b4660 2024-04-16T12:57:42.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.583+0000 7f0afe59c640 1 --2- 172.21.15.106:0/2223690911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4280 0x7f0b00073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:42.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.584+0000 7f0afed9d640 1 --2- 172.21.15.106:0/2223690911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b000b55e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009d90 tx=0x7f0af802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8670c9e096b586 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.584+0000 7f0afd59a640 1 -- 172.21.15.106:0/2223690911 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8039070 con 0x7f0b0006b9b0 2024-04-16T12:57:42.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.584+0000 7f0afd59a640 1 -- 172.21.15.106:0/2223690911 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af802cb30 con 0x7f0b0006b9b0 2024-04-16T12:57:42.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.584+0000 7f0afd59a640 1 -- 172.21.15.106:0/2223690911 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8034440 con 0x7f0b0006b9b0 2024-04-16T12:57:42.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 -- 172.21.15.106:0/2223690911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 msgr2=0x7f0b000b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2223690911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b000b55e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009d90 tx=0x7f0af802bd80 comp rx=0 tx=0).stop 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 -- 172.21.15.106:0/2223690911 shutdown_connections 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2223690911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b000b55e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2223690911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4280 0x7f0b00073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 -- 172.21.15.106:0/2223690911 >> 172.21.15.106:0/2223690911 conn(0x7f0b000ba4d0 msgr2=0x7f0b000ba8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 -- 172.21.15.106:0/2223690911 shutdown_connections 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.585+0000 7f0b04c60640 1 -- 172.21.15.106:0/2223690911 wait complete. 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.586+0000 7f0b04c60640 1 Processor -- start 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.586+0000 7f0b04c60640 1 -- start start 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0b04c60640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b001ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0b04c60640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b000b4280 0x7f0b00146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0b04c60640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4660 0x7f0b001474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0b04c60640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000b6d00 con 0x7f0b0006b9b0 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0b04c60640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00072020 con 0x7f0b000b4280 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0b04c60640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000729e0 con 0x7f0b000b4660 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b001ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b001ddee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33592/0 (socket says 172.21.15.106:33592) 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 -- 172.21.15.106:0/2891591416 learned_addr learned my addr 172.21.15.106:0/2891591416 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afed9d640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4660 0x7f0b001474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afdd9b640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b000b4280 0x7f0b00146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 -- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4660 msgr2=0x7f0b001474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4660 0x7f0b001474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 -- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b000b4280 msgr2=0x7f0b00146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b000b4280 0x7f0b00146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afe59c640 1 -- 172.21.15.106:0/2891591416 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000ae720 con 0x7f0b0006b9b0 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afed9d640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4660 0x7f0b001474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:42.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.587+0000 7f0afdd9b640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b000b4280 0x7f0b00146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.588+0000 7f0afe59c640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b001ddee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0af000e730 tx=0x7f0af000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.588+0000 7f0aeeffd640 1 -- 172.21.15.106:0/2891591416 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000f040 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.588+0000 7f0aeeffd640 1 -- 172.21.15.106:0/2891591416 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af0004230 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.588+0000 7f0aeeffd640 1 -- 172.21.15.106:0/2891591416 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000ee40 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.588+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b001dd6e0 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.588+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b00141160 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.589+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b00068a90 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.589+0000 7f0aeeffd640 1 -- 172.21.15.106:0/2891591416 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0af000c670 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.589+0000 7f0aeeffd640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ae006c8f0 0x7f0ae006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.590+0000 7f0aeeffd640 1 -- 172.21.15.106:0/2891591416 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0af008b830 con 0x7f0b0006b9b0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.590+0000 7f0afdd9b640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ae006c8f0 0x7f0ae006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.590+0000 7f0afdd9b640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ae006c8f0 0x7f0ae006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b00147f70 tx=0x7f0af4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.594+0000 7f0aeeffd640 1 -- 172.21.15.106:0/2891591416 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0af0017020 con 0x7f0b0006b9b0 2024-04-16T12:57:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.767+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0b000b17f0 con 0x7f0b0006b9b0 2024-04-16T12:57:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.768+0000 7f0aeeffd640 1 -- 172.21.15.106:0/2891591416 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f0af0059c70 con 0x7f0b0006b9b0 2024-04-16T12:57:42.769 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:42.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.769+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ae006c8f0 msgr2=0x7f0ae006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.769+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ae006c8f0 0x7f0ae006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b00147f70 tx=0x7f0af4009040 comp rx=0 tx=0).stop 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 msgr2=0x7f0b001ddee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b001ddee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0af000e730 tx=0x7f0af000ebf0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 shutdown_connections 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0ae006c8f0 0x7f0ae006edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b000b4660 0x7f0b001474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b000b4280 0x7f0b00146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 --2- 172.21.15.106:0/2891591416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b0006b9b0 0x7f0b001ddee0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 >> 172.21.15.106:0/2891591416 conn(0x7f0b000ba4d0 msgr2=0x7f0b000ba8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 shutdown_connections 2024-04-16T12:57:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.770+0000 7f0b04c60640 1 -- 172.21.15.106:0/2891591416 wait complete. 2024-04-16T12:57:42.783 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:57:42.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.885+0000 7fbec959d640 1 Processor -- start 2024-04-16T12:57:42.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.885+0000 7fbec959d640 1 -- start start 2024-04-16T12:57:42.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec959d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbec40b2970 0x7fbec413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec959d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec40b3a80 con 0x7fbec413fef0 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec959d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec40bc200 con 0x7fbec40bbe20 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec959d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbec41497d0 con 0x7fbec40b2970 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec37fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbec413fef0 0x7fbec4150410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50714/0 (socket says 172.21.15.106:50714) 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec37fe640 1 -- 172.21.15.106:0/122964412 learned_addr learned my addr 172.21.15.106:0/122964412 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234793252 0 0) 0x7fbec40b3a80 con 0x7fbec413fef0 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb0003520 con 0x7fbec413fef0 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.886+0000 7fbec27fc640 1 --2- 172.21.15.106:0/122964412 >> v2:172.21.15.171:3300/0 conn(0x7fbec40b2970 0x7fbec413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1199433065 0 0) 0x7fbeb0003520 con 0x7fbec413fef0 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 >> v2:172.21.15.171:3300/0 conn(0x7fbec40b2970 msgr2=0x7fbec413f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 --2- 172.21.15.106:0/122964412 >> v2:172.21.15.171:3300/0 conn(0x7fbec40b2970 0x7fbec413f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 >> v1:172.21.15.171:6789/0 conn(0x7fbec40bbe20 legacy=0x7fbec41490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec40b7cb0 con 0x7fbec413fef0 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fbebc001670 con 0x7fbec413fef0 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 >> v1:172.21.15.106:6789/0 conn(0x7fbec413fef0 legacy=0x7fbec4150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb00039b0 0x7fbeb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbeb0004800 0x7fbeb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbeb00051c0 0x7fbeb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41497d0 con 0x7fbeb0004800 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb000c160 con 0x7fbeb00051c0 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb000c360 con 0x7fbeb00039b0 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec27fc640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbeb0004800 0x7fbeb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec2ffd640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb00039b0 0x7fbeb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec37fe640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbeb00051c0 0x7fbeb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec27fc640 1 -- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb00039b0 msgr2=0x7fbeb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec27fc640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb00039b0 0x7fbeb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec27fc640 1 -- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbeb00051c0 msgr2=0x7fbeb000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec27fc640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbeb00051c0 0x7fbeb000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec27fc640 1 -- 172.21.15.106:0/122964412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb0003520 con 0x7fbeb0004800 2024-04-16T12:57:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.887+0000 7fbec37fe640 1 -- 172.21.15.106:0/122964412 reap_dead start 2024-04-16T12:57:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.888+0000 7fbec27fc640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbeb0004800 0x7fbeb0004c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009ac0 tx=0x7fbeb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88566c59a29900d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.888+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac039070 con 0x7fbeb0004800 2024-04-16T12:57:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.888+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac02c6b0 con 0x7fbeb0004800 2024-04-16T12:57:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.888+0000 7fbec1ffb640 1 -- 172.21.15.106:0/122964412 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac009690 con 0x7fbeb0004800 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.889+0000 7fbec959d640 1 -- 172.21.15.106:0/122964412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbeb0004800 msgr2=0x7fbeb0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.889+0000 7fbec959d640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbeb0004800 0x7fbeb0004c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009ac0 tx=0x7fbeb0005830 comp rx=0 tx=0).stop 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.889+0000 7fbec959d640 1 -- 172.21.15.106:0/122964412 shutdown_connections 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.889+0000 7fbec959d640 1 --2- 172.21.15.106:0/122964412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbeb0004800 0x7fbeb0004c80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.889+0000 7fbec959d640 1 -- 172.21.15.106:0/122964412 >> 172.21.15.106:0/122964412 conn(0x7fbec4067e20 msgr2=0x7fbec40bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.889+0000 7fbec959d640 1 -- 172.21.15.106:0/122964412 shutdown_connections 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.889+0000 7fbec959d640 1 -- 172.21.15.106:0/122964412 wait complete. 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 Processor -- start 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 -- start start 2024-04-16T12:57:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb0004800 0x7fbec41481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbec41db6d0 0x7fbec413c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec41dbb50 0x7fbec413cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40b4590 con 0x7fbec41db6d0 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4140300 con 0x7fbec41dbb50 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.890+0000 7fbec959d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbec40b7960 con 0x7fbeb0004800 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbec41db6d0 0x7fbec413c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbec41db6d0 0x7fbec413c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33610/0 (socket says 172.21.15.106:33610) 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 -- 172.21.15.106:0/745896045 learned_addr learned my addr 172.21.15.106:0/745896045 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec2ffd640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb0004800 0x7fbec41481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec37fe640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec41dbb50 0x7fbec413cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 -- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb0004800 msgr2=0x7fbec41481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb0004800 0x7fbec41481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 -- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec41dbb50 msgr2=0x7fbec413cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec41dbb50 0x7fbec413cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 -- 172.21.15.106:0/745896045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec41d0a00 con 0x7fbec41db6d0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec2ffd640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb0004800 0x7fbec41481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec37fe640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec41dbb50 0x7fbec413cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec27fc640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbec41db6d0 0x7fbec413c5e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeac000c00 tx=0x7fbeac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbebb7fe640 1 -- 172.21.15.106:0/745896045 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac042020 con 0x7fbec41db6d0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbebb7fe640 1 -- 172.21.15.106:0/745896045 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac03a040 con 0x7fbec41db6d0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec413d060 con 0x7fbec41db6d0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbebb7fe640 1 -- 172.21.15.106:0/745896045 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac039070 con 0x7fbec41db6d0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.891+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec41d0680 con 0x7fbec41db6d0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.892+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec40691a0 con 0x7fbec41db6d0 2024-04-16T12:57:42.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.893+0000 7fbebb7fe640 1 -- 172.21.15.106:0/745896045 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbeac045020 con 0x7fbec41db6d0 2024-04-16T12:57:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.893+0000 7fbebb7fe640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbea406c8f0 0x7fbea406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.893+0000 7fbebb7fe640 1 -- 172.21.15.106:0/745896045 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbeac0acf70 con 0x7fbec41db6d0 2024-04-16T12:57:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.893+0000 7fbec2ffd640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbea406c8f0 0x7fbea406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.894+0000 7fbec2ffd640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbea406c8f0 0x7fbea406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4000f80 tx=0x7fbeb4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:42.898+0000 7fbebb7fe640 1 -- 172.21.15.106:0/745896045 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbeac04c070 con 0x7fbec41db6d0 2024-04-16T12:57:43.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.087+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbec40b64f0 con 0x7fbec41db6d0 2024-04-16T12:57:43.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.088+0000 7fbebb7fe640 1 -- 172.21.15.106:0/745896045 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fbeac07b430 con 0x7fbec41db6d0 2024-04-16T12:57:43.089 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-16T12:57:43.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbea406c8f0 msgr2=0x7fbea406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbea406c8f0 0x7fbea406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4000f80 tx=0x7fbeb4009040 comp rx=0 tx=0).stop 2024-04-16T12:57:43.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbec41db6d0 msgr2=0x7fbec413c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbec41db6d0 0x7fbec413c5e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeac000c00 tx=0x7fbeac004730 comp rx=0 tx=0).stop 2024-04-16T12:57:43.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 shutdown_connections 2024-04-16T12:57:43.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbea406c8f0 0x7fbea406edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec41dbb50 0x7fbec413cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbec41db6d0 0x7fbec413c5e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 --2- 172.21.15.106:0/745896045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbeb0004800 0x7fbec41481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 >> 172.21.15.106:0/745896045 conn(0x7fbec4067e20 msgr2=0x7fbec4074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:43.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 shutdown_connections 2024-04-16T12:57:43.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.089+0000 7fbec959d640 1 -- 172.21.15.106:0/745896045 wait complete. 2024-04-16T12:57:43.102 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:57:43.102 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:57:43.118 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:43.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.259+0000 7faf1e077640 1 Processor -- start 2024-04-16T12:57:43.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.259+0000 7faf1e077640 1 -- start start 2024-04-16T12:57:43.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf1e077640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf180679d0 0x7faf18149310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf1e077640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf18149850 0x7faf1813f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf1e077640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf18149cb0 con 0x7faf1813fa30 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf1e077640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7faf180afbf0 con 0x7faf18149850 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf1e077640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf18067db0 con 0x7faf180679d0 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf16ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf18149850 0x7faf1813f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf17fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faf1813fa30 0x7faf1806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50716/0 (socket says 172.21.15.106:50716) 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf17fff640 1 -- 172.21.15.106:0/3194126774 learned_addr learned my addr 172.21.15.106:0/3194126774 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf177fe640 1 --2- 172.21.15.106:0/3194126774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf180679d0 0x7faf18149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf16ffd640 1 -- 172.21.15.106:0/3194126774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf180679d0 msgr2=0x7faf18149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf16ffd640 1 --2- 172.21.15.106:0/3194126774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf180679d0 0x7faf18149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf16ffd640 1 -- 172.21.15.106:0/3194126774 >> v1:172.21.15.106:6789/0 conn(0x7faf1813fa30 legacy=0x7faf1806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf16ffd640 1 -- 172.21.15.106:0/3194126774 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf180b0c70 con 0x7faf18149850 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.260+0000 7faf167fc640 1 -- 172.21.15.106:0/3194126774 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964909211 0 0) 0x7faf18149cb0 con 0x7faf1813fa30 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.261+0000 7faf16ffd640 1 --2- 172.21.15.106:0/3194126774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf18149850 0x7faf1813f4f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf000097a0 tx=0x7faf0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74f11f0130c5c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.261+0000 7faf167fc640 1 -- 172.21.15.106:0/3194126774 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00035020 con 0x7faf18149850 2024-04-16T12:57:43.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.261+0000 7faf167fc640 1 -- 172.21.15.106:0/3194126774 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf00031830 con 0x7faf18149850 2024-04-16T12:57:43.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.261+0000 7faf167fc640 1 -- 172.21.15.106:0/3194126774 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00031c00 con 0x7faf18149850 2024-04-16T12:57:43.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.261+0000 7faf1e077640 1 -- 172.21.15.106:0/3194126774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf18149850 msgr2=0x7faf1813f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.261+0000 7faf1e077640 1 --2- 172.21.15.106:0/3194126774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf18149850 0x7faf1813f4f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf000097a0 tx=0x7faf0002b8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.262+0000 7faf1e077640 1 -- 172.21.15.106:0/3194126774 shutdown_connections 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.262+0000 7faf1e077640 1 --2- 172.21.15.106:0/3194126774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf18149850 0x7faf1813f4f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.262+0000 7faf1e077640 1 --2- 172.21.15.106:0/3194126774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf180679d0 0x7faf18149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.262+0000 7faf1e077640 1 -- 172.21.15.106:0/3194126774 >> 172.21.15.106:0/3194126774 conn(0x7faf180b9ca0 msgr2=0x7faf180ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.262+0000 7faf1e077640 1 -- 172.21.15.106:0/3194126774 shutdown_connections 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.262+0000 7faf1e077640 1 -- 172.21.15.106:0/3194126774 wait complete. 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 Processor -- start 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 -- start start 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf180679d0 0x7faf1813be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf1813fa30 0x7faf18144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf18149850 0x7faf181db930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faf180b0990 con 0x7faf180679d0 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faf180b06b0 con 0x7faf18149850 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf1e077640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf180b0360 con 0x7faf1813fa30 2024-04-16T12:57:43.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf177fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf180679d0 0x7faf1813be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf177fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf180679d0 0x7faf1813be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33630/0 (socket says 172.21.15.106:33630) 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.263+0000 7faf177fe640 1 -- 172.21.15.106:0/1859661243 learned_addr learned my addr 172.21.15.106:0/1859661243 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf17fff640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf18149850 0x7faf181db930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf16ffd640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf1813fa30 0x7faf18144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf177fe640 1 -- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf1813fa30 msgr2=0x7faf18144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf177fe640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf1813fa30 0x7faf18144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf177fe640 1 -- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf18149850 msgr2=0x7faf181db930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf177fe640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf18149850 0x7faf181db930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf177fe640 1 -- 172.21.15.106:0/1859661243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1813b150 con 0x7faf180679d0 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf17fff640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf18149850 0x7faf181db930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf177fe640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf180679d0 0x7faf1813be20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c820 tx=0x7faf0800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf0ffff640 1 -- 172.21.15.106:0/1859661243 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08015070 con 0x7faf180679d0 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf0ffff640 1 -- 172.21.15.106:0/1859661243 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf08004240 con 0x7faf180679d0 2024-04-16T12:57:43.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf0ffff640 1 -- 172.21.15.106:0/1859661243 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0800ce10 con 0x7faf180679d0 2024-04-16T12:57:43.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf18144b00 con 0x7faf180679d0 2024-04-16T12:57:43.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.264+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1813a950 con 0x7faf180679d0 2024-04-16T12:57:43.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.265+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf18068a90 con 0x7faf180679d0 2024-04-16T12:57:43.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.266+0000 7faf0ffff640 1 -- 172.21.15.106:0/1859661243 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf08007830 con 0x7faf180679d0 2024-04-16T12:57:43.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.266+0000 7faf0ffff640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faef806c8f0 0x7faef806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.266+0000 7faf0ffff640 1 -- 172.21.15.106:0/1859661243 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf0808b8f0 con 0x7faf180679d0 2024-04-16T12:57:43.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.266+0000 7faf16ffd640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faef806c8f0 0x7faef806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.267+0000 7faf16ffd640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faef806c8f0 0x7faef806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf00036000 tx=0x7faf0003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.270+0000 7faf0ffff640 1 -- 172.21.15.106:0/1859661243 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf08059760 con 0x7faf180679d0 2024-04-16T12:57:43.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.449+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf180aedb0 con 0x7faf180679d0 2024-04-16T12:57:43.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.451+0000 7faf0ffff640 1 -- 172.21.15.106:0/1859661243 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7faf0805da60 con 0x7faf180679d0 2024-04-16T12:57:43.452 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:43.453 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faef806c8f0 msgr2=0x7faef806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faef806c8f0 0x7faef806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf00036000 tx=0x7faf0003c040 comp rx=0 tx=0).stop 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf180679d0 msgr2=0x7faf1813be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf180679d0 0x7faf1813be20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c820 tx=0x7faf0800cce0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 shutdown_connections 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7faef806c8f0 0x7faef806edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf18149850 0x7faf181db930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf1813fa30 0x7faf18144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 --2- 172.21.15.106:0/1859661243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf180679d0 0x7faf1813be20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 >> 172.21.15.106:0/1859661243 conn(0x7faf180b9ca0 msgr2=0x7faf180b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:43.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 shutdown_connections 2024-04-16T12:57:43.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.453+0000 7faf1e077640 1 -- 172.21.15.106:0/1859661243 wait complete. 2024-04-16T12:57:43.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:43.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:43.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.570+0000 7facca73d640 1 Processor -- start 2024-04-16T12:57:43.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.570+0000 7facca73d640 1 -- start start 2024-04-16T12:57:43.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facca73d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facc40b78a0 0x7facc406dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facca73d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc40b6100 0x7facc41525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facca73d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc40b7c80 con 0x7facc406e520 2024-04-16T12:57:43.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facca73d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7facc40b6f80 con 0x7facc40b78a0 2024-04-16T12:57:43.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facca73d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7facc40b1d80 con 0x7facc40b6100 2024-04-16T12:57:43.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facc3fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facc40b78a0 0x7facc406dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facc3fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facc40b78a0 0x7facc406dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33640/0 (socket says 172.21.15.106:33640) 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facc3fff640 1 -- 172.21.15.106:0/259797449 learned_addr learned my addr 172.21.15.106:0/259797449 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facc37fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7facc406e520 0x7facc4141a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50730/0 (socket says 172.21.15.106:50730) 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.571+0000 7facc8cda640 1 --2- 172.21.15.106:0/259797449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc40b6100 0x7facc41525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc3fff640 1 -- 172.21.15.106:0/259797449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc40b6100 msgr2=0x7facc41525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc3fff640 1 --2- 172.21.15.106:0/259797449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc40b6100 0x7facc41525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc3fff640 1 -- 172.21.15.106:0/259797449 >> v1:172.21.15.106:6789/0 conn(0x7facc406e520 legacy=0x7facc4141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc3fff640 1 -- 172.21.15.106:0/259797449 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc40b22a0 con 0x7facc40b78a0 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc2ffd640 1 -- 172.21.15.106:0/259797449 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190830651 0 0) 0x7facc40b7c80 con 0x7facc406e520 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc3fff640 1 --2- 172.21.15.106:0/259797449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b78a0 0x7facc406dfe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facb4009870 tx=0x7facb402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6963a5f0750c51 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc2ffd640 1 -- 172.21.15.106:0/259797449 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40317c0 con 0x7facc40b78a0 2024-04-16T12:57:43.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc2ffd640 1 -- 172.21.15.106:0/259797449 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb4037070 con 0x7facc40b78a0 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.572+0000 7facc2ffd640 1 -- 172.21.15.106:0/259797449 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4031b80 con 0x7facc40b78a0 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 -- 172.21.15.106:0/259797449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b78a0 msgr2=0x7facc406dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 --2- 172.21.15.106:0/259797449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b78a0 0x7facc406dfe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facb4009870 tx=0x7facb402b860 comp rx=0 tx=0).stop 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 -- 172.21.15.106:0/259797449 shutdown_connections 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 --2- 172.21.15.106:0/259797449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc40b6100 0x7facc41525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 --2- 172.21.15.106:0/259797449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b78a0 0x7facc406dfe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 -- 172.21.15.106:0/259797449 >> 172.21.15.106:0/259797449 conn(0x7facc40b7e90 msgr2=0x7facc40b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 -- 172.21.15.106:0/259797449 shutdown_connections 2024-04-16T12:57:43.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.573+0000 7facca73d640 1 -- 172.21.15.106:0/259797449 wait complete. 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.574+0000 7facca73d640 1 Processor -- start 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.574+0000 7facca73d640 1 -- start start 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facca73d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc406e520 0x7facc4145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facca73d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b6100 0x7facc40b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facca73d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facc40b78a0 0x7facc40b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facca73d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7facc40b5f10 con 0x7facc40b6100 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facca73d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7facc40b5d90 con 0x7facc40b78a0 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facca73d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7facc41421a0 con 0x7facc406e520 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b6100 0x7facc40b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b6100 0x7facc40b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33642/0 (socket says 172.21.15.106:33642) 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 -- 172.21.15.106:0/814038269 learned_addr learned my addr 172.21.15.106:0/814038269 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc3fff640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc406e520 0x7facc4145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc8cda640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facc40b78a0 0x7facc40b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 -- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc406e520 msgr2=0x7facc4145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc406e520 0x7facc4145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 -- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facc40b78a0 msgr2=0x7facc40b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facc40b78a0 0x7facc40b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 -- 172.21.15.106:0/814038269 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc40b4950 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.575+0000 7facc37fe640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b6100 0x7facc40b4120 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facb800c430 tx=0x7facb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.576+0000 7facc0ff9640 1 -- 172.21.15.106:0/814038269 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb80074e0 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.576+0000 7facc0ff9640 1 -- 172.21.15.106:0/814038269 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb80047e0 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.576+0000 7facc0ff9640 1 -- 172.21.15.106:0/814038269 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8004c10 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.576+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc40b4660 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.576+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc41e0bf0 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.577+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc40b2f70 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.577+0000 7facc0ff9640 1 -- 172.21.15.106:0/814038269 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facb8011070 con 0x7facc40b6100 2024-04-16T12:57:43.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.577+0000 7facc0ff9640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7facb006c8f0 0x7facb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.578+0000 7facc0ff9640 1 -- 172.21.15.106:0/814038269 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7facb808b670 con 0x7facc40b6100 2024-04-16T12:57:43.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.578+0000 7facc3fff640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7facb006c8f0 0x7facb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.578+0000 7facc3fff640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7facb006c8f0 0x7facb006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7facb4036000 tx=0x7facb4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.582+0000 7facc0ff9640 1 -- 172.21.15.106:0/814038269 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7facb801a2b0 con 0x7facc40b6100 2024-04-16T12:57:43.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.755+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facc406c210 con 0x7facc40b6100 2024-04-16T12:57:43.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.755+0000 7facc0ff9640 1 -- 172.21.15.106:0/814038269 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7facb8059b30 con 0x7facc40b6100 2024-04-16T12:57:43.757 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:43.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7facb006c8f0 msgr2=0x7facb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7facb006c8f0 0x7facb006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7facb4036000 tx=0x7facb4008030 comp rx=0 tx=0).stop 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b6100 msgr2=0x7facc40b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b6100 0x7facc40b4120 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facb800c430 tx=0x7facb800c8f0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 shutdown_connections 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7facb006c8f0 0x7facb006edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facc40b78a0 0x7facc40b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facc40b6100 0x7facc40b4120 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 --2- 172.21.15.106:0/814038269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facc406e520 0x7facc4145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 >> 172.21.15.106:0/814038269 conn(0x7facc40b7e90 msgr2=0x7facc4145c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 shutdown_connections 2024-04-16T12:57:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.758+0000 7facca73d640 1 -- 172.21.15.106:0/814038269 wait complete. 2024-04-16T12:57:43.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:43.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.876+0000 7fe8d1340640 1 Processor -- start 2024-04-16T12:57:43.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.876+0000 7fe8d1340640 1 -- start start 2024-04-16T12:57:43.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8d1340640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8d1340640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8cc0b66c0 0x7fe8cc14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8d1340640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe8cc141c20 0x7fe8cc1420b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8d1340640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe8cc0b5200 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8d1340640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe8cc0b7930 con 0x7fe8cc141c20 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8d1340640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe8cc1425f0 con 0x7fe8cc0bdf90 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8cc0b66c0 0x7fe8cc14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8cc0b66c0 0x7fe8cc14ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33658/0 (socket says 172.21.15.106:33658) 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 -- 172.21.15.106:0/3697150060 learned_addr learned my addr 172.21.15.106:0/3697150060 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8caffd640 1 --2- 172.21.15.106:0/3697150060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8cb7fe640 1 --2- 172.21.15.106:0/3697150060 >> v2:172.21.15.171:3300/0 conn(0x7fe8cc141c20 0x7fe8cc1420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 -- 172.21.15.106:0/3697150060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 msgr2=0x7fe8cc14b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 --2- 172.21.15.106:0/3697150060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 -- 172.21.15.106:0/3697150060 >> v2:172.21.15.171:3300/0 conn(0x7fe8cc141c20 msgr2=0x7fe8cc1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:43.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 --2- 172.21.15.106:0/3697150060 >> v2:172.21.15.171:3300/0 conn(0x7fe8cc141c20 0x7fe8cc1420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8ca7fc640 1 -- 172.21.15.106:0/3697150060 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc0be370 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.877+0000 7fe8cb7fe640 1 --2- 172.21.15.106:0/3697150060 >> v2:172.21.15.171:3300/0 conn(0x7fe8cc141c20 0x7fe8cc1420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:43.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.878+0000 7fe8ca7fc640 1 --2- 172.21.15.106:0/3697150060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc14ba30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0b9cc0 tx=0x7fe8c002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaff367de6d63d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.878+0000 7fe8c9ffb640 1 -- 172.21.15.106:0/3697150060 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00317d0 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.878+0000 7fe8c9ffb640 1 -- 172.21.15.106:0/3697150060 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c0037070 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.878+0000 7fe8c9ffb640 1 -- 172.21.15.106:0/3697150060 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0031b90 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 -- 172.21.15.106:0/3697150060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 msgr2=0x7fe8cc14ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 --2- 172.21.15.106:0/3697150060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc14ba30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0b9cc0 tx=0x7fe8c002b870 comp rx=0 tx=0).stop 2024-04-16T12:57:43.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 -- 172.21.15.106:0/3697150060 shutdown_connections 2024-04-16T12:57:43.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 --2- 172.21.15.106:0/3697150060 >> v2:172.21.15.171:3300/0 conn(0x7fe8cc141c20 0x7fe8cc1420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 --2- 172.21.15.106:0/3697150060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc14ba30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 --2- 172.21.15.106:0/3697150060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc14b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 -- 172.21.15.106:0/3697150060 >> 172.21.15.106:0/3697150060 conn(0x7fe8cc067e70 msgr2=0x7fe8cc0bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 -- 172.21.15.106:0/3697150060 shutdown_connections 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.879+0000 7fe8d1340640 1 -- 172.21.15.106:0/3697150060 wait complete. 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 Processor -- start 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 -- start start 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc0b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8cc141c20 0x7fe8cc13e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc0b4e90 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc0b4bb0 con 0x7fe8cc141c20 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8d1340640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe8cc0b55d0 con 0x7fe8cc0bdf90 2024-04-16T12:57:43.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8caffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.880+0000 7fe8caffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33664/0 (socket says 172.21.15.106:33664) 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8caffd640 1 -- 172.21.15.106:0/4199633193 learned_addr learned my addr 172.21.15.106:0/4199633193 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8ca7fc640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc0b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8cb7fe640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8cc141c20 0x7fe8cc13e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8caffd640 1 -- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 msgr2=0x7fe8cc0b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8caffd640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc0b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8caffd640 1 -- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8cc141c20 msgr2=0x7fe8cc13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8caffd640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8cc141c20 0x7fe8cc13e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8caffd640 1 -- 172.21.15.106:0/4199633193 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc1d1100 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8caffd640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc144390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00ce40 tx=0x7fe8bc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8b37fe640 1 -- 172.21.15.106:0/4199633193 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc003b90 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8b37fe640 1 -- 172.21.15.106:0/4199633193 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8bc003d30 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc1dda20 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8b37fe640 1 -- 172.21.15.106:0/4199633193 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc004260 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.881+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc1d0e20 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.882+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8cc1ddbf0 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.883+0000 7fe8b37fe640 1 -- 172.21.15.106:0/4199633193 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8bc004400 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.883+0000 7fe8b37fe640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe8b806c8f0 0x7fe8b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:43.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.883+0000 7fe8b37fe640 1 -- 172.21.15.106:0/4199633193 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe8bc08c690 con 0x7fe8cc0b66c0 2024-04-16T12:57:43.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.883+0000 7fe8ca7fc640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe8b806c8f0 0x7fe8b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:43.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.883+0000 7fe8ca7fc640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe8b806c8f0 0x7fe8b806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0036000 tx=0x7fe8c003d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:43.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:43.887+0000 7fe8b37fe640 1 -- 172.21.15.106:0/4199633193 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe8bc05aad0 con 0x7fe8cc0b66c0 2024-04-16T12:57:44.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.064+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe8cc1419f0 con 0x7fe8cc0b66c0 2024-04-16T12:57:44.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.065+0000 7fe8b37fe640 1 -- 172.21.15.106:0/4199633193 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe8cc1419f0 con 0x7fe8cc0b66c0 2024-04-16T12:57:44.066 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:44.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe8b806c8f0 msgr2=0x7fe8b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe8b806c8f0 0x7fe8b806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0036000 tx=0x7fe8c003d040 comp rx=0 tx=0).stop 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 msgr2=0x7fe8cc144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc144390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00ce40 tx=0x7fe8bc00a660 comp rx=0 tx=0).stop 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 shutdown_connections 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe8b806c8f0 0x7fe8b806edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8cc141c20 0x7fe8cc13e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8cc0bdf90 0x7fe8cc0b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 --2- 172.21.15.106:0/4199633193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8cc0b66c0 0x7fe8cc144390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 >> 172.21.15.106:0/4199633193 conn(0x7fe8cc067e70 msgr2=0x7fe8cc0b86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 shutdown_connections 2024-04-16T12:57:44.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.067+0000 7fe8d1340640 1 -- 172.21.15.106:0/4199633193 wait complete. 2024-04-16T12:57:44.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:44.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.184+0000 7f8a5af8d640 1 Processor -- start 2024-04-16T12:57:44.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.184+0000 7f8a5af8d640 1 -- start start 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a5af8d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a5406e5d0 0x7f8a54148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a5af8d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8a540b5510 0x7f8a54148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a5af8d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5406e9b0 con 0x7f8a540b7a40 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a5af8d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5406cac0 con 0x7f8a5406e5d0 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a5af8d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5406cd10 con 0x7f8a540b5510 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a58d29640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a5406e5d0 0x7f8a54148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a58d29640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a5406e5d0 0x7f8a54148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33670/0 (socket says 172.21.15.106:33670) 2024-04-16T12:57:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a58d29640 1 -- 172.21.15.106:0/516056130 learned_addr learned my addr 172.21.15.106:0/516056130 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a58d29640 1 -- 172.21.15.106:0/516056130 >> v2:172.21.15.171:3300/0 conn(0x7f8a540b5510 msgr2=0x7f8a54148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.185+0000 7f8a5952a640 1 --2- 172.21.15.106:0/516056130 >> v2:172.21.15.171:3300/0 conn(0x7f8a540b5510 0x7f8a54148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.186+0000 7f8a58d29640 1 --2- 172.21.15.106:0/516056130 >> v2:172.21.15.171:3300/0 conn(0x7f8a540b5510 0x7f8a54148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.186+0000 7f8a58d29640 1 -- 172.21.15.106:0/516056130 >> v1:172.21.15.171:6789/0 conn(0x7f8a540b7a40 legacy=0x7f8a540b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.186+0000 7f8a58d29640 1 -- 172.21.15.106:0/516056130 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a54147e10 con 0x7f8a5406e5d0 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.186+0000 7f8a5952a640 1 --2- 172.21.15.106:0/516056130 >> v2:172.21.15.171:3300/0 conn(0x7f8a540b5510 0x7f8a54148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.186+0000 7f8a58d29640 1 --2- 172.21.15.106:0/516056130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54148330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a54068e30 tx=0x7f8a4402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ae24ae231f5ef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.186+0000 7f8a537fe640 1 -- 172.21.15.106:0/516056130 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4402c960 con 0x7f8a5406e5d0 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a537fe640 1 -- 172.21.15.106:0/516056130 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4402cb00 con 0x7f8a5406e5d0 2024-04-16T12:57:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a537fe640 1 -- 172.21.15.106:0/516056130 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a440343f0 con 0x7f8a5406e5d0 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 -- 172.21.15.106:0/516056130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 msgr2=0x7f8a54148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/516056130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54148330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a54068e30 tx=0x7f8a4402bdc0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 -- 172.21.15.106:0/516056130 shutdown_connections 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/516056130 >> v2:172.21.15.171:3300/0 conn(0x7f8a540b5510 0x7f8a54148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/516056130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54148330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 -- 172.21.15.106:0/516056130 >> 172.21.15.106:0/516056130 conn(0x7f8a540bb400 msgr2=0x7f8a540bb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 -- 172.21.15.106:0/516056130 shutdown_connections 2024-04-16T12:57:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.187+0000 7f8a5af8d640 1 -- 172.21.15.106:0/516056130 wait complete. 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.188+0000 7f8a5af8d640 1 Processor -- start 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.188+0000 7f8a5af8d640 1 -- start start 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5af8d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5af8d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a540b5510 0x7f8a5413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5af8d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a540b7a40 0x7f8a5413b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5af8d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5406de40 con 0x7f8a5406e5d0 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5af8d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541525a0 con 0x7f8a540b5510 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5af8d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8a54152720 con 0x7f8a540b7a40 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33682/0 (socket says 172.21.15.106:33682) 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 -- 172.21.15.106:0/1195080592 learned_addr learned my addr 172.21.15.106:0/1195080592 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5952a640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a540b7a40 0x7f8a5413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a53fff640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a540b5510 0x7f8a5413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 -- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a540b7a40 msgr2=0x7f8a5413b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a540b7a40 0x7f8a5413b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 -- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a540b5510 msgr2=0x7f8a5413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a540b5510 0x7f8a5413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 -- 172.21.15.106:0/1195080592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5413fcf0 con 0x7f8a5406e5d0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a5952a640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a540b7a40 0x7f8a5413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a53fff640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a540b5510 0x7f8a5413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.189+0000 7f8a58d29640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54144650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a44036040 tx=0x7f8a44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.190+0000 7f8a517fa640 1 -- 172.21.15.106:0/1195080592 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44043020 con 0x7f8a5406e5d0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.190+0000 7f8a517fa640 1 -- 172.21.15.106:0/1195080592 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4403e450 con 0x7f8a5406e5d0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.190+0000 7f8a517fa640 1 -- 172.21.15.106:0/1195080592 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4403e840 con 0x7f8a5406e5d0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.190+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a54145520 con 0x7f8a5406e5d0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.190+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a541e1440 con 0x7f8a5406e5d0 2024-04-16T12:57:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.191+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5413eb70 con 0x7f8a5406e5d0 2024-04-16T12:57:44.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.191+0000 7f8a517fa640 1 -- 172.21.15.106:0/1195080592 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a44046020 con 0x7f8a5406e5d0 2024-04-16T12:57:44.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.191+0000 7f8a517fa640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8a3406c8f0 0x7f8a3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.192+0000 7f8a53fff640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8a3406c8f0 0x7f8a3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.192+0000 7f8a517fa640 1 -- 172.21.15.106:0/1195080592 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8a440ae4e0 con 0x7f8a5406e5d0 2024-04-16T12:57:44.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.192+0000 7f8a53fff640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8a3406c8f0 0x7f8a3406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00a830 tx=0x7f8a3c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.196+0000 7f8a517fa640 1 -- 172.21.15.106:0/1195080592 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a5413eb70 con 0x7f8a5406e5d0 2024-04-16T12:57:44.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.372+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8a540691a0 con 0x7f8a5406e5d0 2024-04-16T12:57:44.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.372+0000 7f8a517fa640 1 -- 172.21.15.106:0/1195080592 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f8a4404d030 con 0x7f8a5406e5d0 2024-04-16T12:57:44.374 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:44.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8a3406c8f0 msgr2=0x7f8a3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8a3406c8f0 0x7f8a3406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00a830 tx=0x7f8a3c008040 comp rx=0 tx=0).stop 2024-04-16T12:57:44.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 msgr2=0x7f8a54144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54144650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a44036040 tx=0x7f8a44004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:44.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 shutdown_connections 2024-04-16T12:57:44.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8a3406c8f0 0x7f8a3406edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a540b7a40 0x7f8a5413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a540b5510 0x7f8a5413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 --2- 172.21.15.106:0/1195080592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a5406e5d0 0x7f8a54144650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 >> 172.21.15.106:0/1195080592 conn(0x7f8a540bb400 msgr2=0x7f8a54146a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:44.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 shutdown_connections 2024-04-16T12:57:44.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.374+0000 7f8a5af8d640 1 -- 172.21.15.106:0/1195080592 wait complete. 2024-04-16T12:57:44.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:57:44.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.489+0000 7f99e6235640 1 Processor -- start 2024-04-16T12:57:44.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.489+0000 7f99e6235640 1 -- start start 2024-04-16T12:57:44.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99e6235640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e00b0ac0 0x7f99e00b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99e6235640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99e009fb60 0x7f99e00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99e6235640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e0067db0 con 0x7f99e00679d0 2024-04-16T12:57:44.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99e6235640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f99e00b45f0 con 0x7f99e009fb60 2024-04-16T12:57:44.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99e6235640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f99e00b01c0 con 0x7f99e00b0ac0 2024-04-16T12:57:44.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99dffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99e009fb60 0x7f99e00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99df7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f99e00679d0 0x7f99e0144d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50746/0 (socket says 172.21.15.106:50746) 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99dffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99e009fb60 0x7f99e00afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33694/0 (socket says 172.21.15.106:33694) 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99df7fe640 1 -- 172.21.15.106:0/584266115 learned_addr learned my addr 172.21.15.106:0/584266115 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99deffd640 1 --2- 172.21.15.106:0/584266115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e00b0ac0 0x7f99e00b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99dffff640 1 -- 172.21.15.106:0/584266115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e00b0ac0 msgr2=0x7f99e00b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99dffff640 1 --2- 172.21.15.106:0/584266115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e00b0ac0 0x7f99e00b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99dffff640 1 -- 172.21.15.106:0/584266115 >> v1:172.21.15.106:6789/0 conn(0x7f99e00679d0 legacy=0x7f99e0144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99dffff640 1 -- 172.21.15.106:0/584266115 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e00b5b10 con 0x7f99e009fb60 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.490+0000 7f99de7fc640 1 -- 172.21.15.106:0/584266115 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895489741 0 0) 0x7f99e0067db0 con 0x7f99e00679d0 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.491+0000 7f99dffff640 1 --2- 172.21.15.106:0/584266115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e009fb60 0x7f99e00afc80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99d80097a0 tx=0x7f99d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127802163fc2729a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.491+0000 7f99de7fc640 1 -- 172.21.15.106:0/584266115 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8035020 con 0x7f99e009fb60 2024-04-16T12:57:44.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.491+0000 7f99de7fc640 1 -- 172.21.15.106:0/584266115 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d8031830 con 0x7f99e009fb60 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.491+0000 7f99de7fc640 1 -- 172.21.15.106:0/584266115 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8031c00 con 0x7f99e009fb60 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 -- 172.21.15.106:0/584266115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e009fb60 msgr2=0x7f99e00afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 --2- 172.21.15.106:0/584266115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e009fb60 0x7f99e00afc80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99d80097a0 tx=0x7f99d802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 -- 172.21.15.106:0/584266115 shutdown_connections 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 --2- 172.21.15.106:0/584266115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e009fb60 0x7f99e00afc80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 --2- 172.21.15.106:0/584266115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e00b0ac0 0x7f99e00b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 -- 172.21.15.106:0/584266115 >> 172.21.15.106:0/584266115 conn(0x7f99e00b9ca0 msgr2=0x7f99e00ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 -- 172.21.15.106:0/584266115 shutdown_connections 2024-04-16T12:57:44.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.492+0000 7f99e6235640 1 -- 172.21.15.106:0/584266115 wait complete. 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 Processor -- start 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 -- start start 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00679d0 0x7f99e0147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e009fb60 0x7f99e00b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e00b0ac0 0x7f99e01e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f99e0145450 con 0x7f99e00b0ac0 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f99e00b57d0 con 0x7f99e00679d0 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.493+0000 7f99e6235640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f99e01455d0 con 0x7f99e009fb60 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e00b0ac0 0x7f99e01e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e00b0ac0 0x7f99e01e0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33698/0 (socket says 172.21.15.106:33698) 2024-04-16T12:57:44.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 -- 172.21.15.106:0/2592411408 learned_addr learned my addr 172.21.15.106:0/2592411408 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99deffd640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e009fb60 0x7f99e00b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99df7fe640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00679d0 0x7f99e0147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 -- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e009fb60 msgr2=0x7f99e00b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e009fb60 0x7f99e00b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 -- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00679d0 msgr2=0x7f99e0147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00679d0 0x7f99e0147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 -- 172.21.15.106:0/2592411408 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e00b2730 con 0x7f99e00b0ac0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99deffd640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e009fb60 0x7f99e00b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99dffff640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e00b0ac0 0x7f99e01e0ea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99d80098c0 tx=0x7f99d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99c7fff640 1 -- 172.21.15.106:0/2592411408 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8041070 con 0x7f99e00b0ac0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99c7fff640 1 -- 172.21.15.106:0/2592411408 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d803a8d0 con 0x7f99e00b0ac0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e00b3d30 con 0x7f99e00b0ac0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99c7fff640 1 -- 172.21.15.106:0/2592411408 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8035040 con 0x7f99e00b0ac0 2024-04-16T12:57:44.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.494+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e01486e0 con 0x7f99e00b0ac0 2024-04-16T12:57:44.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.495+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e00b3b50 con 0x7f99e00b0ac0 2024-04-16T12:57:44.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.496+0000 7f99c7fff640 1 -- 172.21.15.106:0/2592411408 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99d8038020 con 0x7f99e00b0ac0 2024-04-16T12:57:44.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.496+0000 7f99c7fff640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f99cc06c8f0 0x7f99cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.496+0000 7f99c7fff640 1 -- 172.21.15.106:0/2592411408 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f99d80ad4c0 con 0x7f99e00b0ac0 2024-04-16T12:57:44.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.496+0000 7f99df7fe640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f99cc06c8f0 0x7f99cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.496+0000 7f99df7fe640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f99cc06c8f0 0x7f99cc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99d00012e0 tx=0x7f99d0007ed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.500+0000 7f99c7fff640 1 -- 172.21.15.106:0/2592411408 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99e00b3b50 con 0x7f99e00b0ac0 2024-04-16T12:57:44.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.687+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f99e0068a90 con 0x7f99e00b0ac0 2024-04-16T12:57:44.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.688+0000 7f99c7fff640 1 -- 172.21.15.106:0/2592411408 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f99d807b8f0 con 0x7f99e00b0ac0 2024-04-16T12:57:44.689 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-16T12:57:44.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f99cc06c8f0 msgr2=0x7f99cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f99cc06c8f0 0x7f99cc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99d00012e0 tx=0x7f99d0007ed0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e00b0ac0 msgr2=0x7f99e01e0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e00b0ac0 0x7f99e01e0ea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99d80098c0 tx=0x7f99d80046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 shutdown_connections 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f99cc06c8f0 0x7f99cc06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e00b0ac0 0x7f99e01e0ea0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e009fb60 0x7f99e00b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 --2- 172.21.15.106:0/2592411408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00679d0 0x7f99e0147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 >> 172.21.15.106:0/2592411408 conn(0x7f99e00b9ca0 msgr2=0x7f99e00b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 shutdown_connections 2024-04-16T12:57:44.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.690+0000 7f99e6235640 1 -- 172.21.15.106:0/2592411408 wait complete. 2024-04-16T12:57:44.703 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2024-04-16T12:57:44.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:44.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-16T12:57:44.731 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:57:44.732 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:57:44.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:57:44.732 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T12:57:44.799 INFO:tasks.cephfs.cephfs_test_case:[] 2024-04-16T12:57:44.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:44.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.940+0000 7facb93cd640 1 Processor -- start 2024-04-16T12:57:44.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.940+0000 7facb93cd640 1 -- start start 2024-04-16T12:57:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb93cd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7facb41421e0 0x7facb4073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb93cd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb40bb240 con 0x7facb4071cf0 2024-04-16T12:57:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb93cd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb40720d0 con 0x7facb414b340 2024-04-16T12:57:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb93cd640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7facb4073280 con 0x7facb41421e0 2024-04-16T12:57:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb2ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7facb4071cf0 0x7facb40b0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50756/0 (socket says 172.21.15.106:50756) 2024-04-16T12:57:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb2ffd640 1 -- 172.21.15.106:0/1417333400 learned_addr learned my addr 172.21.15.106:0/1417333400 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb37fe640 1 --2- 172.21.15.106:0/1417333400 >> v2:172.21.15.171:3300/0 conn(0x7facb41421e0 0x7facb4073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.941+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970604133 0 0) 0x7facb40bb240 con 0x7facb4071cf0 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faca0003520 con 0x7facb4071cf0 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1054209572 0 0) 0x7faca0003520 con 0x7facb4071cf0 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 >> v2:172.21.15.171:3300/0 conn(0x7facb41421e0 msgr2=0x7facb4073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 --2- 172.21.15.106:0/1417333400 >> v2:172.21.15.171:3300/0 conn(0x7facb41421e0 0x7facb4073af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 >> v1:172.21.15.171:6789/0 conn(0x7facb414b340 legacy=0x7facb4141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb40bac80 con 0x7facb4071cf0 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7facac001670 con 0x7facb4071cf0 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 >> v1:172.21.15.106:6789/0 conn(0x7facb4071cf0 legacy=0x7facb40b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7faca0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faca0004800 0x7faca0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faca00052e0 0x7faca000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7facb4073280 con 0x7faca00039b0 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faca000c1b0 con 0x7faca0004800 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faca000c3b0 con 0x7faca00052e0 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb2ffd640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7faca0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb27fc640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faca0004800 0x7faca0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb37fe640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faca00052e0 0x7faca000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb2ffd640 1 -- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faca00052e0 msgr2=0x7faca000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb2ffd640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faca00052e0 0x7faca000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb2ffd640 1 -- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faca0004800 msgr2=0x7faca0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb2ffd640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faca0004800 0x7faca0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb37fe640 1 -- 172.21.15.106:0/1417333400 reap_dead start 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.942+0000 7facb2ffd640 1 -- 172.21.15.106:0/1417333400 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca0003520 con 0x7faca00039b0 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.943+0000 7facb2ffd640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7faca0003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7facac00c210 tx=0x7faca0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a26b7de9f490269 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.943+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac007d10 con 0x7faca00039b0 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.943+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac030070 con 0x7faca00039b0 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.943+0000 7facb1ffb640 1 -- 172.21.15.106:0/1417333400 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac005d90 con 0x7faca00039b0 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.944+0000 7facb93cd640 1 -- 172.21.15.106:0/1417333400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 msgr2=0x7faca0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.944+0000 7facb93cd640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7faca0003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7facac00c210 tx=0x7faca0005830 comp rx=0 tx=0).stop 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.944+0000 7facb93cd640 1 -- 172.21.15.106:0/1417333400 shutdown_connections 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.944+0000 7facb93cd640 1 --2- 172.21.15.106:0/1417333400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7faca0003dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.944+0000 7facb93cd640 1 -- 172.21.15.106:0/1417333400 >> 172.21.15.106:0/1417333400 conn(0x7facb406d150 msgr2=0x7facb40ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.944+0000 7facb93cd640 1 -- 172.21.15.106:0/1417333400 shutdown_connections 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.944+0000 7facb93cd640 1 -- 172.21.15.106:0/1417333400 wait complete. 2024-04-16T12:57:44.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 Processor -- start 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 -- start start 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7facb41de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb41de5c0 0x7facb41d3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb41d3980 0x7facb4138510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7facb4073c70 con 0x7faca00039b0 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7facb4073af0 con 0x7facb41d3980 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb93cd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7facb4073df0 con 0x7facb41de5c0 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.945+0000 7facb2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7facb41de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7facb41de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33708/0 (socket says 172.21.15.106:33708) 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 -- 172.21.15.106:0/1308196764 learned_addr learned my addr 172.21.15.106:0/1308196764 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb27fc640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb41de5c0 0x7facb41d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 -- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb41de5c0 msgr2=0x7facb41d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb37fe640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb41d3980 0x7facb4138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb41de5c0 0x7facb41d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 -- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb41d3980 msgr2=0x7facb4138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb41d3980 0x7facb4138510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 -- 172.21.15.106:0/1308196764 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb41d2760 con 0x7faca00039b0 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb2ffd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7facb41de080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7facac00c300 tx=0x7facb40bae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facab7fe640 1 -- 172.21.15.106:0/1308196764 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac045070 con 0x7faca00039b0 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facab7fe640 1 -- 172.21.15.106:0/1308196764 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0049f0 con 0x7faca00039b0 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb41dea40 con 0x7faca00039b0 2024-04-16T12:57:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facab7fe640 1 -- 172.21.15.106:0/1308196764 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac007d10 con 0x7faca00039b0 2024-04-16T12:57:44.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.946+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb41d16c0 con 0x7faca00039b0 2024-04-16T12:57:44.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.947+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb40691a0 con 0x7faca00039b0 2024-04-16T12:57:44.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.948+0000 7facab7fe640 1 -- 172.21.15.106:0/1308196764 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facac007070 con 0x7faca00039b0 2024-04-16T12:57:44.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.948+0000 7facab7fe640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fac9406c8f0 0x7fac9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:44.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.948+0000 7facab7fe640 1 -- 172.21.15.106:0/1308196764 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7facac0ac4a0 con 0x7faca00039b0 2024-04-16T12:57:44.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.948+0000 7facb27fc640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fac9406c8f0 0x7fac9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:44.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.948+0000 7facb27fc640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fac9406c8f0 0x7fac9406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fac9c000f80 tx=0x7fac9c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:44.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:44.952+0000 7facab7fe640 1 -- 172.21.15.106:0/1308196764 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7facb41dea40 con 0x7faca00039b0 2024-04-16T12:57:45.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.166+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facb414c000 con 0x7faca00039b0 2024-04-16T12:57:45.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.166+0000 7facab7fe640 1 -- 172.21.15.106:0/1308196764 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7facac07a310 con 0x7faca00039b0 2024-04-16T12:57:45.168 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:45.168 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:45.168 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:45.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fac9406c8f0 msgr2=0x7fac9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fac9406c8f0 0x7fac9406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fac9c000f80 tx=0x7fac9c009040 comp rx=0 tx=0).stop 2024-04-16T12:57:45.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 msgr2=0x7facb41de080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7facb41de080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7facac00c300 tx=0x7facb40bae50 comp rx=0 tx=0).stop 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 shutdown_connections 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fac9406c8f0 0x7fac9406edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb41d3980 0x7facb4138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb41de5c0 0x7facb41d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 --2- 172.21.15.106:0/1308196764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca00039b0 0x7facb41de080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 >> 172.21.15.106:0/1308196764 conn(0x7facb406d150 msgr2=0x7facb4140fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 shutdown_connections 2024-04-16T12:57:45.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.168+0000 7facb93cd640 1 -- 172.21.15.106:0/1308196764 wait complete. 2024-04-16T12:57:45.181 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:45.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.283+0000 7f65275c8640 1 Processor -- start 2024-04-16T12:57:45.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.283+0000 7f65275c8640 1 -- start start 2024-04-16T12:57:45.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.283+0000 7f65275c8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f65200b9d30 0x7f652006f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.283+0000 7f65275c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 0x7f652006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.283+0000 7f65275c8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652006fb20 con 0x7f65200b82b0 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.283+0000 7f65275c8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f65200b9630 con 0x7f65200b9d30 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.283+0000 7f65275c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f65200b7400 con 0x7f652006f6b0 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6524b63640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f65200b82b0 0x7f652006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50770/0 (socket says 172.21.15.106:50770) 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6524b63640 1 -- 172.21.15.106:0/2125308127 learned_addr learned my addr 172.21.15.106:0/2125308127 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525b65640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 0x7f652006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775017518 0 0) 0x7f652006fb20 con 0x7f65200b82b0 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525364640 1 --2- 172.21.15.106:0/2125308127 >> v2:172.21.15.171:3300/0 conn(0x7f65200b9d30 0x7f652006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f650c003520 con 0x7f65200b82b0 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2367536543 0 0) 0x7f650c003520 con 0x7f65200b82b0 2024-04-16T12:57:45.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 msgr2=0x7f652006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 0x7f652006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 >> v2:172.21.15.171:3300/0 conn(0x7f65200b9d30 msgr2=0x7f652006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 --2- 172.21.15.106:0/2125308127 >> v2:172.21.15.171:3300/0 conn(0x7f65200b9d30 0x7f652006f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652006ec50 con 0x7f65200b82b0 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f651c001670 con 0x7f65200b82b0 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 >> v1:172.21.15.106:6789/0 conn(0x7f65200b82b0 legacy=0x7f652006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f650c0039b0 0x7f650c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c004800 0x7f650c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 0x7f650c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f65200b9630 con 0x7f650c0039b0 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65200b7400 con 0x7f650c004800 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f650c00b9c0 con 0x7f652006f6b0 2024-04-16T12:57:45.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525364640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f650c0039b0 0x7f650c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525b65640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 0x7f650c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6524b63640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c004800 0x7f650c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525364640 1 -- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 msgr2=0x7f650c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525364640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 0x7f650c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525364640 1 -- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c004800 msgr2=0x7f650c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525364640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c004800 0x7f650c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525364640 1 -- 172.21.15.106:0/2125308127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c003520 con 0x7f650c0039b0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.284+0000 7f6525b65640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652006f6b0 0x7f650c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.285+0000 7f6525364640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f650c0039b0 0x7f650c003dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6510009af0 tx=0x7f650c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84f5675c030dee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.285+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510039070 con 0x7f650c0039b0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.285+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651002c710 con 0x7f650c0039b0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.285+0000 7f6517fff640 1 -- 172.21.15.106:0/2125308127 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510009690 con 0x7f650c0039b0 2024-04-16T12:57:45.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.286+0000 7f65275c8640 1 -- 172.21.15.106:0/2125308127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f650c0039b0 msgr2=0x7f650c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.286+0000 7f65275c8640 1 --2- 172.21.15.106:0/2125308127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f650c0039b0 0x7f650c003dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6510009af0 tx=0x7f650c005830 comp rx=0 tx=0).stop 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.286+0000 7f6525b65640 1 -- 172.21.15.106:0/2125308127 reap_dead start 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.286+0000 7f65275c8640 1 -- 172.21.15.106:0/2125308127 shutdown_connections 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.286+0000 7f65275c8640 1 -- 172.21.15.106:0/2125308127 >> 172.21.15.106:0/2125308127 conn(0x7f65200ba4b0 msgr2=0x7f65200ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.286+0000 7f65275c8640 1 -- 172.21.15.106:0/2125308127 shutdown_connections 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.286+0000 7f65275c8640 1 -- 172.21.15.106:0/2125308127 wait complete. 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.287+0000 7f65275c8640 1 Processor -- start 2024-04-16T12:57:45.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.287+0000 7f65275c8640 1 -- start start 2024-04-16T12:57:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c0039b0 0x7f65200b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65201e0a60 0x7f65201cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65201ce320 0x7f65200b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f65200ba110 con 0x7f65201e0a60 2024-04-16T12:57:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65200bb340 con 0x7f650c0039b0 2024-04-16T12:57:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f652006c0c0 con 0x7f65201ce320 2024-04-16T12:57:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65201e0a60 0x7f65201cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65201e0a60 0x7f65201cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33722/0 (socket says 172.21.15.106:33722) 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 -- 172.21.15.106:0/1190451026 learned_addr learned my addr 172.21.15.106:0/1190451026 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6525364640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c0039b0 0x7f65200b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6525b65640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65201ce320 0x7f65200b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 -- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65201ce320 msgr2=0x7f65200b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65201ce320 0x7f65200b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 -- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c0039b0 msgr2=0x7f65200b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c0039b0 0x7f65200b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 -- 172.21.15.106:0/1190451026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65201d07d0 con 0x7f65201e0a60 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6524b63640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65201e0a60 0x7f65201cdde0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f651c001860 tx=0x7f651c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6515ffb640 1 -- 172.21.15.106:0/1190451026 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c00ee60 con 0x7f65201e0a60 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6515ffb640 1 -- 172.21.15.106:0/1190451026 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c018070 con 0x7f65201e0a60 2024-04-16T12:57:45.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65201ce7a0 con 0x7f65201e0a60 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f6515ffb640 1 -- 172.21.15.106:0/1190451026 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c00cab0 con 0x7f65201e0a60 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.288+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65201d1a90 con 0x7f65201e0a60 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.289+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6520068a90 con 0x7f65201e0a60 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.290+0000 7f6515ffb640 1 -- 172.21.15.106:0/1190451026 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f651c00cc50 con 0x7f65201e0a60 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.290+0000 7f6515ffb640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f650406c920 0x7f650406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.290+0000 7f6515ffb640 1 -- 172.21.15.106:0/1190451026 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f651c08b790 con 0x7f65201e0a60 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.290+0000 7f6525364640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f650406c920 0x7f650406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.291+0000 7f6525364640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f650406c920 0x7f650406ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6510036000 tx=0x7f6510030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.295+0000 7f6515ffb640 1 -- 172.21.15.106:0/1190451026 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f651c059600 con 0x7f65201e0a60 2024-04-16T12:57:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.471+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65200b8d90 con 0x7f65201e0a60 2024-04-16T12:57:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.472+0000 7f6515ffb640 1 -- 172.21.15.106:0/1190451026 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f651c05d900 con 0x7f65201e0a60 2024-04-16T12:57:45.474 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:45.474 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:45.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f650406c920 msgr2=0x7f650406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f650406c920 0x7f650406ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6510036000 tx=0x7f6510030000 comp rx=0 tx=0).stop 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65201e0a60 msgr2=0x7f65201cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65201e0a60 0x7f65201cdde0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f651c001860 tx=0x7f651c00ec10 comp rx=0 tx=0).stop 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 shutdown_connections 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f650406c920 0x7f650406ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65201ce320 0x7f65200b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65201e0a60 0x7f65201cdde0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 --2- 172.21.15.106:0/1190451026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f650c0039b0 0x7f65200b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 >> 172.21.15.106:0/1190451026 conn(0x7f65200ba4b0 msgr2=0x7f65201cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 shutdown_connections 2024-04-16T12:57:45.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.474+0000 7f65275c8640 1 -- 172.21.15.106:0/1190451026 wait complete. 2024-04-16T12:57:45.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:57:16.202733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:57:17.194394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:45.487 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.590+0000 7f5f08cc1640 1 Processor -- start 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.590+0000 7f5f08cc1640 1 -- start start 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f08cc1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040b7490 0x7f5f0413c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f08cc1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5f040b7870 0x7f5f041503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f08cc1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f040b3640 con 0x7f5f0413c6e0 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f08cc1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f5f040b3920 con 0x7f5f040b7870 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f08cc1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f041464e0 con 0x7f5f040b7490 2024-04-16T12:57:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f02d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5f040b7870 0x7f5f041503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f02d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5f040b7870 0x7f5f041503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33726/0 (socket says 172.21.15.106:33726) 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5efbfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5f0413c6e0 0x7f5f04149480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50782/0 (socket says 172.21.15.106:50782) 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f02d9d640 1 -- 172.21.15.106:0/2246034067 learned_addr learned my addr 172.21.15.106:0/2246034067 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f0259c640 1 --2- 172.21.15.106:0/2246034067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040b7490 0x7f5f0413c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f02d9d640 1 -- 172.21.15.106:0/2246034067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040b7490 msgr2=0x7f5f0413c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f02d9d640 1 --2- 172.21.15.106:0/2246034067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040b7490 0x7f5f0413c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f02d9d640 1 -- 172.21.15.106:0/2246034067 >> v1:172.21.15.106:6789/0 conn(0x7f5f0413c6e0 legacy=0x7f5f04149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f02d9d640 1 -- 172.21.15.106:0/2246034067 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f041467c0 con 0x7f5f040b7870 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f01d9b640 1 -- 172.21.15.106:0/2246034067 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612326553 0 0) 0x7f5f040b3640 con 0x7f5f0413c6e0 2024-04-16T12:57:45.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.591+0000 7f5f0259c640 1 --2- 172.21.15.106:0/2246034067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040b7490 0x7f5f0413c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.592+0000 7f5f02d9d640 1 --2- 172.21.15.106:0/2246034067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7870 0x7f5f041503c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8294ea19f30cd66 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.592+0000 7f5f01d9b640 1 -- 172.21.15.106:0/2246034067 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc02cb00 con 0x7f5f040b7870 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.592+0000 7f5f01d9b640 1 -- 172.21.15.106:0/2246034067 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc02cca0 con 0x7f5f040b7870 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.592+0000 7f5f01d9b640 1 -- 172.21.15.106:0/2246034067 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc034610 con 0x7f5f040b7870 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 -- 172.21.15.106:0/2246034067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7870 msgr2=0x7f5f041503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/2246034067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7870 0x7f5f041503c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02bf60 comp rx=0 tx=0).stop 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 -- 172.21.15.106:0/2246034067 shutdown_connections 2024-04-16T12:57:45.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/2246034067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7870 0x7f5f041503c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/2246034067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040b7490 0x7f5f0413c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 -- 172.21.15.106:0/2246034067 >> 172.21.15.106:0/2246034067 conn(0x7f5f040b7e90 msgr2=0x7f5f040b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 -- 172.21.15.106:0/2246034067 shutdown_connections 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.593+0000 7f5f08cc1640 1 -- 172.21.15.106:0/2246034067 wait complete. 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 Processor -- start 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 -- start start 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7490 0x7f5f04148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040b7870 0x7f5f04136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f041de480 0x7f5f041de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5f04149d10 con 0x7f5f040b7490 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f04149b90 con 0x7f5f040b7870 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f08cc1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0413fa20 con 0x7f5f041de480 2024-04-16T12:57:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.594+0000 7f5f0259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7490 0x7f5f04148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7490 0x7f5f04148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33742/0 (socket says 172.21.15.106:33742) 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 -- 172.21.15.106:0/1170158056 learned_addr learned my addr 172.21.15.106:0/1170158056 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f02d9d640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f041de480 0x7f5f041de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5efbfff640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040b7870 0x7f5f04136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 -- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f041de480 msgr2=0x7f5f041de8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f041de480 0x7f5f041de8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 -- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040b7870 msgr2=0x7f5f04136ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040b7870 0x7f5f04136ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 -- 172.21.15.106:0/1170158056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f04136750 con 0x7f5f040b7490 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f0259c640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7490 0x7f5f04148040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c820 tx=0x7f5ef400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5efaffd640 1 -- 172.21.15.106:0/1170158056 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4015070 con 0x7f5f040b7490 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5efaffd640 1 -- 172.21.15.106:0/1170158056 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4007a30 con 0x7f5f040b7490 2024-04-16T12:57:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f04137220 con 0x7f5f040b7490 2024-04-16T12:57:45.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5efaffd640 1 -- 172.21.15.106:0/1170158056 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4007e00 con 0x7f5f040b7490 2024-04-16T12:57:45.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.595+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f041374a0 con 0x7f5f040b7490 2024-04-16T12:57:45.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.596+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0406c210 con 0x7f5f040b7490 2024-04-16T12:57:45.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.597+0000 7f5efaffd640 1 -- 172.21.15.106:0/1170158056 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ef4018070 con 0x7f5f040b7490 2024-04-16T12:57:45.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.597+0000 7f5efaffd640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5ee406c8f0 0x7f5ee406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.597+0000 7f5efaffd640 1 -- 172.21.15.106:0/1170158056 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef408b9e0 con 0x7f5f040b7490 2024-04-16T12:57:45.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.597+0000 7f5efbfff640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5ee406c8f0 0x7f5ee406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.598+0000 7f5efbfff640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5ee406c8f0 0x7f5ee406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f0413e680 tx=0x7f5eec007de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.602+0000 7f5efaffd640 1 -- 172.21.15.106:0/1170158056 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f04137220 con 0x7f5f040b7490 2024-04-16T12:57:45.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.776+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f04068a90 con 0x7f5f040b7490 2024-04-16T12:57:45.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.777+0000 7f5efaffd640 1 -- 172.21.15.106:0/1170158056 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5ef4059850 con 0x7f5f040b7490 2024-04-16T12:57:45.778 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:45.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.778+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5ee406c8f0 msgr2=0x7f5ee406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.778+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5ee406c8f0 0x7f5ee406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f0413e680 tx=0x7f5eec007de0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7490 msgr2=0x7f5f04148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7490 0x7f5f04148040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c820 tx=0x7f5ef400cc20 comp rx=0 tx=0).stop 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 shutdown_connections 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f5ee406c8f0 0x7f5ee406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f041de480 0x7f5f041de8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040b7870 0x7f5f04136ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 --2- 172.21.15.106:0/1170158056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f040b7490 0x7f5f04148040 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 >> 172.21.15.106:0/1170158056 conn(0x7f5f040b7e90 msgr2=0x7f5f040bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 shutdown_connections 2024-04-16T12:57:45.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.779+0000 7f5f08cc1640 1 -- 172.21.15.106:0/1170158056 wait complete. 2024-04-16T12:57:45.791 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:57:45.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.895+0000 7ffabd9fa640 1 Processor -- start 2024-04-16T12:57:45.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.895+0000 7ffabd9fa640 1 -- start start 2024-04-16T12:57:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffabd9fa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffab80b6780 0x7ffab81418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffabd9fa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab8141de0 0x7ffab80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffabd9fa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab81488d0 con 0x7ffab80b63a0 2024-04-16T12:57:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffabd9fa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ffab8148b70 con 0x7ffab80b6780 2024-04-16T12:57:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffabd9fa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80b4bd0 con 0x7ffab8141de0 2024-04-16T12:57:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab67fc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffab80b6780 0x7ffab81418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab8141de0 0x7ffab80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab6ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ffab80b63a0 0x7ffab81481c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53470/0 (socket says 172.21.15.106:53470) 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab67fc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffab80b6780 0x7ffab81418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:46520/0 (socket says 172.21.15.106:46520) 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab8141de0 0x7ffab80b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:57698/0 (socket says 172.21.15.106:57698) 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab6ffd640 1 -- 172.21.15.106:0/2073312334 learned_addr learned my addr 172.21.15.106:0/2073312334 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab67fc640 1 -- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab8141de0 msgr2=0x7ffab80b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab67fc640 1 --2- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab8141de0 0x7ffab80b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab67fc640 1 -- 172.21.15.106:0/2073312334 >> v1:172.21.15.171:6789/0 conn(0x7ffab80b63a0 legacy=0x7ffab81481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab5ffb640 1 -- 172.21.15.106:0/2073312334 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884575640 0 0) 0x7ffab81488d0 con 0x7ffab80b63a0 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab67fc640 1 -- 172.21.15.106:0/2073312334 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80b4eb0 con 0x7ffab80b6780 2024-04-16T12:57:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.896+0000 7ffab77fe640 1 --2- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab8141de0 0x7ffab80b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.897+0000 7ffab67fc640 1 --2- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b6780 0x7ffab81418a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0097a0 tx=0x7ffaac02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e06aa7f772ee495 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.897+0000 7ffab5ffb640 1 -- 172.21.15.106:0/2073312334 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0315a0 con 0x7ffab80b6780 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.897+0000 7ffab5ffb640 1 -- 172.21.15.106:0/2073312334 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaac037070 con 0x7ffab80b6780 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.897+0000 7ffab5ffb640 1 -- 172.21.15.106:0/2073312334 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac031960 con 0x7ffab80b6780 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 -- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b6780 msgr2=0x7ffab81418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b6780 0x7ffab81418a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0097a0 tx=0x7ffaac02b840 comp rx=0 tx=0).stop 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 -- 172.21.15.106:0/2073312334 shutdown_connections 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab8141de0 0x7ffab80b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/2073312334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b6780 0x7ffab81418a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 -- 172.21.15.106:0/2073312334 >> 172.21.15.106:0/2073312334 conn(0x7ffab8068080 msgr2=0x7ffab80bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 -- 172.21.15.106:0/2073312334 shutdown_connections 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.898+0000 7ffabd9fa640 1 -- 172.21.15.106:0/2073312334 wait complete. 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.899+0000 7ffabd9fa640 1 Processor -- start 2024-04-16T12:57:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.899+0000 7ffabd9fa640 1 -- start start 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffabd9fa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b63a0 0x7ffab813ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffabd9fa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab80b6780 0x7ffab813fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffabd9fa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab8141de0 0x7ffab813e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffabd9fa640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80b5ce0 con 0x7ffab8141de0 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffabd9fa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80b5b60 con 0x7ffab80b63a0 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffabd9fa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffab8152610 con 0x7ffab80b6780 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab8141de0 0x7ffab813e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab8141de0 0x7ffab813e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33754/0 (socket says 172.21.15.106:33754) 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 -- 172.21.15.106:0/1260472244 learned_addr learned my addr 172.21.15.106:0/1260472244 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab6ffd640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b63a0 0x7ffab813ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab67fc640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab80b6780 0x7ffab813fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 -- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab80b6780 msgr2=0x7ffab813fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab80b6780 0x7ffab813fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 -- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b63a0 msgr2=0x7ffab813ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b63a0 0x7ffab813ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 -- 172.21.15.106:0/1260472244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab8142df0 con 0x7ffab8141de0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffab77fe640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab8141de0 0x7ffab813e270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffab000efc0 tx=0x7ffab000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffa9ffff640 1 -- 172.21.15.106:0/1260472244 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0018030 con 0x7ffab8141de0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.900+0000 7ffa9ffff640 1 -- 172.21.15.106:0/1260472244 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab000cdf0 con 0x7ffab8141de0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.901+0000 7ffa9ffff640 1 -- 172.21.15.106:0/1260472244 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0003bb0 con 0x7ffab8141de0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.901+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab8142a10 con 0x7ffab8141de0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.901+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab8152300 con 0x7ffab8141de0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.901+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab8140010 con 0x7ffab8141de0 2024-04-16T12:57:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.902+0000 7ffa9ffff640 1 -- 172.21.15.106:0/1260472244 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffab0005d10 con 0x7ffab8141de0 2024-04-16T12:57:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.902+0000 7ffa9ffff640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.903+0000 7ffa9ffff640 1 -- 172.21.15.106:0/1260472244 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffab008c330 con 0x7ffab8141de0 2024-04-16T12:57:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.903+0000 7ffab6ffd640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.903+0000 7ffab6ffd640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8000f60 tx=0x7ffaa8007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:45.907+0000 7ffa9ffff640 1 -- 172.21.15.106:0/1260472244 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffab8140010 con 0x7ffab8141de0 2024-04-16T12:57:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.081+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffab8141b40 con 0x7ffab8141de0 2024-04-16T12:57:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.082+0000 7ffa9ffff640 1 -- 172.21.15.106:0/1260472244 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7ffab8141b40 con 0x7ffab8141de0 2024-04-16T12:57:46.083 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-16T12:57:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.083+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 msgr2=0x7ffaa406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.083+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8000f60 tx=0x7ffaa8007d50 comp rx=0 tx=0).stop 2024-04-16T12:57:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.083+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab8141de0 msgr2=0x7ffab813e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.083+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab8141de0 0x7ffab813e270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffab000efc0 tx=0x7ffab000c490 comp rx=0 tx=0).stop 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.083+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 shutdown_connections 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.083+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.083+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab8141de0 0x7ffab813e270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.084+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab80b6780 0x7ffab813fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.084+0000 7ffabd9fa640 1 --2- 172.21.15.106:0/1260472244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab80b63a0 0x7ffab813ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.084+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 >> 172.21.15.106:0/1260472244 conn(0x7ffab8068080 msgr2=0x7ffab80bb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.084+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 shutdown_connections 2024-04-16T12:57:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.084+0000 7ffabd9fa640 1 -- 172.21.15.106:0/1260472244 wait complete. 2024-04-16T12:57:46.096 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:57:46.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.201+0000 7ffaca50d640 1 Processor -- start 2024-04-16T12:57:46.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.201+0000 7ffaca50d640 1 -- start start 2024-04-16T12:57:46.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffaca50d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 0x7ffac4073970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffaca50d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac406d6a0 con 0x7ffac414d320 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffaca50d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac41450e0 con 0x7ffac406d2c0 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffaca50d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffac40ae3a0 con 0x7ffac40734f0 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac8aaa640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffac414d320 0x7ffac414f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50784/0 (socket says 172.21.15.106:50784) 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac8aaa640 1 -- 172.21.15.106:0/276187552 learned_addr learned my addr 172.21.15.106:0/276187552 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffabbfff640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 0x7ffac4073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720079400 0 0) 0x7ffac406d6a0 con 0x7ffac414d320 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab0003520 con 0x7ffac414d320 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 325994558 0 0) 0x7ffab0003520 con 0x7ffac414d320 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 msgr2=0x7ffac4073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac37fe640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 0x7ffac4073970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.202+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 >> v1:172.21.15.171:6789/0 conn(0x7ffac406d2c0 legacy=0x7ffac41449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac40afa10 con 0x7ffac414d320 2024-04-16T12:57:46.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7ffabc0019f0 con 0x7ffac414d320 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 >> v1:172.21.15.106:6789/0 conn(0x7ffac414d320 legacy=0x7ffac414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab00039e0 0x7ffab0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 0x7ffab0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab0004d40 0x7ffab00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffac40ae3a0 con 0x7ffab00039e0 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffab000ba70 con 0x7ffab0004d40 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffab000bc70 con 0x7ffac40734f0 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac3fff640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab00039e0 0x7ffab0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffabbfff640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 0x7ffab0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac8aaa640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab0004d40 0x7ffab00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac3fff640 1 -- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 msgr2=0x7ffab0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac3fff640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffac40734f0 0x7ffab0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac3fff640 1 -- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab0004d40 msgr2=0x7ffab00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac3fff640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab0004d40 0x7ffab00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac3fff640 1 -- 172.21.15.106:0/276187552 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab0003520 con 0x7ffab00039e0 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.203+0000 7ffac8aaa640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffab0004d40 0x7ffab00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffac3fff640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab00039e0 0x7ffab0003dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffab4001860 tx=0x7ffab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41909e02f4aa3e12 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab402f050 con 0x7ffab00039e0 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab4033650 con 0x7ffab00039e0 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffac37fe640 1 -- 172.21.15.106:0/276187552 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4001430 con 0x7ffab00039e0 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffaca50d640 1 -- 172.21.15.106:0/276187552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab00039e0 msgr2=0x7ffab0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffaca50d640 1 --2- 172.21.15.106:0/276187552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab00039e0 0x7ffab0003dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffab4001860 tx=0x7ffab0005830 comp rx=0 tx=0).stop 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffac8aaa640 1 -- 172.21.15.106:0/276187552 reap_dead start 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffaca50d640 1 -- 172.21.15.106:0/276187552 shutdown_connections 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.204+0000 7ffaca50d640 1 -- 172.21.15.106:0/276187552 >> 172.21.15.106:0/276187552 conn(0x7ffac40b92c0 msgr2=0x7ffac40b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:46.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.205+0000 7ffaca50d640 1 -- 172.21.15.106:0/276187552 shutdown_connections 2024-04-16T12:57:46.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.205+0000 7ffaca50d640 1 -- 172.21.15.106:0/276187552 wait complete. 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 Processor -- start 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 -- start start 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab00039e0 0x7ffac413ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac414a730 0x7ffac41e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffac41e10e0 0x7ffac409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffac406e340 con 0x7ffac41e10e0 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffac40b5230 con 0x7ffac414a730 2024-04-16T12:57:46.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffaca50d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffac40b03f0 con 0x7ffab00039e0 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffac8aaa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffac41e10e0 0x7ffac409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffac8aaa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffac41e10e0 0x7ffac409aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33766/0 (socket says 172.21.15.106:33766) 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffac8aaa640 1 -- 172.21.15.106:0/3336980418 learned_addr learned my addr 172.21.15.106:0/3336980418 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffabbfff640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac414a730 0x7ffac41e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffac8aaa640 1 -- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab00039e0 msgr2=0x7ffac413ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.206+0000 7ffac8aaa640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab00039e0 0x7ffac413ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffac8aaa640 1 -- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac414a730 msgr2=0x7ffac41e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffac8aaa640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac414a730 0x7ffac41e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffac8aaa640 1 -- 172.21.15.106:0/3336980418 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac414aef0 con 0x7ffac41e10e0 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffabbfff640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac414a730 0x7ffac41e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffac8aaa640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffac41e10e0 0x7ffac409aa60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffac40af660 tx=0x7ffabc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffac17fa640 1 -- 172.21.15.106:0/3336980418 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00eb90 con 0x7ffac41e10e0 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffac17fa640 1 -- 172.21.15.106:0/3336980418 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc00ed30 con 0x7ffac41e10e0 2024-04-16T12:57:46.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffac17fa640 1 -- 172.21.15.106:0/3336980418 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0146a0 con 0x7ffac41e10e0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac414b1d0 con 0x7ffac41e10e0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.207+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac41397a0 con 0x7ffac41e10e0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.208+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac4068a90 con 0x7ffac41e10e0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.208+0000 7ffac17fa640 1 -- 172.21.15.106:0/3336980418 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffabc014840 con 0x7ffac41e10e0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.209+0000 7ffac17fa640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.209+0000 7ffac17fa640 1 -- 172.21.15.106:0/3336980418 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffabc08ba30 con 0x7ffac41e10e0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.209+0000 7ffac3fff640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.209+0000 7ffac3fff640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffab4036000 tx=0x7ffab4009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.213+0000 7ffac17fa640 1 -- 172.21.15.106:0/3336980418 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffabc059e50 con 0x7ffac41e10e0 2024-04-16T12:57:46.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.390+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffac409c780 con 0x7ffac41e10e0 2024-04-16T12:57:46.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.390+0000 7ffac17fa640 1 -- 172.21.15.106:0/3336980418 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ffabc059750 con 0x7ffac41e10e0 2024-04-16T12:57:46.391 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 msgr2=0x7ffaa406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffab4036000 tx=0x7ffab4009030 comp rx=0 tx=0).stop 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffac41e10e0 msgr2=0x7ffac409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffac41e10e0 0x7ffac409aa60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffac40af660 tx=0x7ffabc00e530 comp rx=0 tx=0).stop 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 shutdown_connections 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffaa406c8f0 0x7ffaa406edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffac41e10e0 0x7ffac409aa60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac414a730 0x7ffac41e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 --2- 172.21.15.106:0/3336980418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffab00039e0 0x7ffac413ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 >> 172.21.15.106:0/3336980418 conn(0x7ffac40b92c0 msgr2=0x7ffac40b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:46.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 shutdown_connections 2024-04-16T12:57:46.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.392+0000 7ffaca50d640 1 -- 172.21.15.106:0/3336980418 wait complete. 2024-04-16T12:57:46.404 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:46.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.505+0000 7f09be64a640 1 Processor -- start 2024-04-16T12:57:46.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.505+0000 7f09be64a640 1 -- start start 2024-04-16T12:57:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09be64a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80679d0 0x7f09b80b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09be64a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f09b80b0ac0 0x7f09b80afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09be64a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b8067db0 con 0x7f09b809fb60 2024-04-16T12:57:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09be64a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f09b80b45f0 con 0x7f09b80b0ac0 2024-04-16T12:57:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09be64a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09b80b01c0 con 0x7f09b80679d0 2024-04-16T12:57:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09affff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f09b80b0ac0 0x7f09b80afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09affff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f09b80b0ac0 0x7f09b80afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:46550/0 (socket says 172.21.15.106:46550) 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09b7fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80679d0 0x7f09b80b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09bcbe7640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f09b809fb60 0x7f09b8144d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50792/0 (socket says 172.21.15.106:50792) 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09affff640 1 -- 172.21.15.106:0/112714339 learned_addr learned my addr 172.21.15.106:0/112714339 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09b77fe640 1 -- 172.21.15.106:0/112714339 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585125407 0 0) 0x7f09b8067db0 con 0x7f09b809fb60 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09affff640 1 -- 172.21.15.106:0/112714339 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80679d0 msgr2=0x7f09b80b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09affff640 1 --2- 172.21.15.106:0/112714339 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80679d0 0x7f09b80b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09affff640 1 -- 172.21.15.106:0/112714339 >> v1:172.21.15.106:6789/0 conn(0x7f09b809fb60 legacy=0x7f09b8144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.506+0000 7f09affff640 1 -- 172.21.15.106:0/112714339 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b80b5b10 con 0x7f09b80b0ac0 2024-04-16T12:57:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.507+0000 7f09affff640 1 --2- 172.21.15.106:0/112714339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80b0ac0 0x7f09b80afc80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4a8a946e763be8f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09b77fe640 1 -- 172.21.15.106:0/112714339 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0034070 con 0x7f09b80b0ac0 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09b77fe640 1 -- 172.21.15.106:0/112714339 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a0030840 con 0x7f09b80b0ac0 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09b77fe640 1 -- 172.21.15.106:0/112714339 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0030c10 con 0x7f09b80b0ac0 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 -- 172.21.15.106:0/112714339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80b0ac0 msgr2=0x7f09b80afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 --2- 172.21.15.106:0/112714339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80b0ac0 0x7f09b80afc80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a002b980 comp rx=0 tx=0).stop 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 -- 172.21.15.106:0/112714339 shutdown_connections 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 --2- 172.21.15.106:0/112714339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80b0ac0 0x7f09b80afc80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 --2- 172.21.15.106:0/112714339 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80679d0 0x7f09b80b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 -- 172.21.15.106:0/112714339 >> 172.21.15.106:0/112714339 conn(0x7f09b80b9ca0 msgr2=0x7f09b80ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 -- 172.21.15.106:0/112714339 shutdown_connections 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.508+0000 7f09be64a640 1 -- 172.21.15.106:0/112714339 wait complete. 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.509+0000 7f09be64a640 1 Processor -- start 2024-04-16T12:57:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.509+0000 7f09be64a640 1 -- start start 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09be64a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80679d0 0x7f09b81479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09be64a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b809fb60 0x7f09b81e0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09be64a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80b0ac0 0x7f09b81e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09be64a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8145450 con 0x7f09b809fb60 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09be64a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f09b80b57d0 con 0x7f09b80679d0 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09be64a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09b81455d0 con 0x7f09b80b0ac0 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b809fb60 0x7f09b81e0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b809fb60 0x7f09b81e0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33768/0 (socket says 172.21.15.106:33768) 2024-04-16T12:57:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 -- 172.21.15.106:0/1316892837 learned_addr learned my addr 172.21.15.106:0/1316892837 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09bcbe7640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80b0ac0 0x7f09b81e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09b7fff640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80679d0 0x7f09b81479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 -- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80b0ac0 msgr2=0x7f09b81e1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80b0ac0 0x7f09b81e1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 -- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80679d0 msgr2=0x7f09b81479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80679d0 0x7f09b81479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 -- 172.21.15.106:0/1316892837 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b80b3dc0 con 0x7f09b809fb60 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09bcbe7640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80b0ac0 0x7f09b81e1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09b7fff640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80679d0 0x7f09b81479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.510+0000 7f09affff640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b809fb60 0x7f09b81e0dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.511+0000 7f09b57fa640 1 -- 172.21.15.106:0/1316892837 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0034040 con 0x7f09b809fb60 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.511+0000 7f09b57fa640 1 -- 172.21.15.106:0/1316892837 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a0030640 con 0x7f09b809fb60 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.511+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b81ce720 con 0x7f09b809fb60 2024-04-16T12:57:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.511+0000 7f09b57fa640 1 -- 172.21.15.106:0/1316892837 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0039d40 con 0x7f09b809fb60 2024-04-16T12:57:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.511+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b80b3a50 con 0x7f09b809fb60 2024-04-16T12:57:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.512+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b80b41b0 con 0x7f09b809fb60 2024-04-16T12:57:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.512+0000 7f09b57fa640 1 -- 172.21.15.106:0/1316892837 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09a004b060 con 0x7f09b809fb60 2024-04-16T12:57:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.512+0000 7f09b57fa640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f099806c8f0 0x7f099806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.513+0000 7f09b57fa640 1 -- 172.21.15.106:0/1316892837 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f09a00ad7e0 con 0x7f09b809fb60 2024-04-16T12:57:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.513+0000 7f09b7fff640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f099806c8f0 0x7f099806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.513+0000 7f09b7fff640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f099806c8f0 0x7f099806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009af0 tx=0x7f09a8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.517+0000 7f09b57fa640 1 -- 172.21.15.106:0/1316892837 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f09b80b41b0 con 0x7f09b809fb60 2024-04-16T12:57:46.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.731+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09b8068a90 con 0x7f09b809fb60 2024-04-16T12:57:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.731+0000 7f09b57fa640 1 -- 172.21.15.106:0/1316892837 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f09a004ce90 con 0x7f09b809fb60 2024-04-16T12:57:46.733 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:46.733 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f099806c8f0 msgr2=0x7f099806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f099806c8f0 0x7f099806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009af0 tx=0x7f09a8008040 comp rx=0 tx=0).stop 2024-04-16T12:57:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b809fb60 msgr2=0x7f09b81e0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b809fb60 0x7f09b81e0dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009870 tx=0x7f09a00046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 shutdown_connections 2024-04-16T12:57:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f099806c8f0 0x7f099806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09b80b0ac0 0x7f09b81e1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b809fb60 0x7f09b81e0dd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 --2- 172.21.15.106:0/1316892837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09b80679d0 0x7f09b81479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 >> 172.21.15.106:0/1316892837 conn(0x7f09b80b9ca0 msgr2=0x7f09b8071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 shutdown_connections 2024-04-16T12:57:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.733+0000 7f09be64a640 1 -- 172.21.15.106:0/1316892837 wait complete. 2024-04-16T12:57:46.746 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:46.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 Processor -- start 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 -- start start 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ca006bff0 0x7f6ca009b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca00b7dd0 0x7f6ca0148660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6ca0141bf0 0x7f6ca0142080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca006c3d0 con 0x7f6ca006bff0 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca0148ba0 con 0x7f6ca0141bf0 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9f59e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca009c880 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.848+0000 7f6c9e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ca006bff0 0x7f6ca009b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ca006bff0 0x7f6ca009b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33782/0 (socket says 172.21.15.106:33782) 2024-04-16T12:57:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 -- 172.21.15.106:0/1005214680 learned_addr learned my addr 172.21.15.106:0/1005214680 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9ed9d640 1 --2- 172.21.15.106:0/1005214680 >> v2:172.21.15.171:3300/0 conn(0x7f6ca0141bf0 0x7f6ca0142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c95d9b640 1 --2- 172.21.15.106:0/1005214680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca00b7dd0 0x7f6ca0148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 -- 172.21.15.106:0/1005214680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca00b7dd0 msgr2=0x7f6ca0148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 --2- 172.21.15.106:0/1005214680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca00b7dd0 0x7f6ca0148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 -- 172.21.15.106:0/1005214680 >> v2:172.21.15.171:3300/0 conn(0x7f6ca0141bf0 msgr2=0x7f6ca0142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 --2- 172.21.15.106:0/1005214680 >> v2:172.21.15.171:3300/0 conn(0x7f6ca0141bf0 0x7f6ca0142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 -- 172.21.15.106:0/1005214680 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca0147e60 con 0x7f6ca006bff0 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.849+0000 7f6c9e59c640 1 --2- 172.21.15.106:0/1005214680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca006bff0 0x7f6ca009b430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00a2770 tx=0x7f6c9002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490c98d00fd7eda7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9dd9b640 1 -- 172.21.15.106:0/1005214680 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9002e070 con 0x7f6ca006bff0 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9dd9b640 1 -- 172.21.15.106:0/1005214680 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c90037070 con 0x7f6ca006bff0 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9dd9b640 1 -- 172.21.15.106:0/1005214680 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90031a00 con 0x7f6ca006bff0 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 -- 172.21.15.106:0/1005214680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca006bff0 msgr2=0x7f6ca009b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/1005214680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca006bff0 0x7f6ca009b430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00a2770 tx=0x7f6c9002b880 comp rx=0 tx=0).stop 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 -- 172.21.15.106:0/1005214680 shutdown_connections 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/1005214680 >> v2:172.21.15.171:3300/0 conn(0x7f6ca0141bf0 0x7f6ca0142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/1005214680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca00b7dd0 0x7f6ca0148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/1005214680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca006bff0 0x7f6ca009b430 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 -- 172.21.15.106:0/1005214680 >> 172.21.15.106:0/1005214680 conn(0x7f6ca00bd450 msgr2=0x7f6ca00bd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 -- 172.21.15.106:0/1005214680 shutdown_connections 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.850+0000 7f6c9f59e640 1 -- 172.21.15.106:0/1005214680 wait complete. 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 Processor -- start 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 -- start start 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca006bff0 0x7f6ca00b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca00b7dd0 0x7f6ca00b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ca0141bf0 0x7f6ca01e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca014b1c0 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca009c500 con 0x7f6ca0141bf0 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c9f59e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca014b340 con 0x7f6ca006bff0 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c95d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca00b7dd0 0x7f6ca00b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c95d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca00b7dd0 0x7f6ca00b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33792/0 (socket says 172.21.15.106:33792) 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.852+0000 7f6c95d9b640 1 -- 172.21.15.106:0/716632548 learned_addr learned my addr 172.21.15.106:0/716632548 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c9e59c640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca006bff0 0x7f6ca00b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c9ed9d640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ca0141bf0 0x7f6ca01e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c95d9b640 1 -- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca006bff0 msgr2=0x7f6ca00b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c95d9b640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca006bff0 0x7f6ca00b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c95d9b640 1 -- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ca0141bf0 msgr2=0x7f6ca01e0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c95d9b640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ca0141bf0 0x7f6ca01e0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c95d9b640 1 -- 172.21.15.106:0/716632548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca00b62f0 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c9e59c640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca006bff0 0x7f6ca00b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c9ed9d640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ca0141bf0 0x7f6ca01e0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c95d9b640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca00b7dd0 0x7f6ca00b53d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c7f0 tx=0x7f6c8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c977fe640 1 -- 172.21.15.106:0/716632548 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88015070 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c977fe640 1 -- 172.21.15.106:0/716632548 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c88004220 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca00b5cd0 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c977fe640 1 -- 172.21.15.106:0/716632548 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88007620 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.853+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca0142660 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.854+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca0068a90 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.854+0000 7f6c977fe640 1 -- 172.21.15.106:0/716632548 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c880079d0 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.855+0000 7f6c977fe640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6c8006c8f0 0x7f6c8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.855+0000 7f6c977fe640 1 -- 172.21.15.106:0/716632548 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c8808be90 con 0x7f6ca00b7dd0 2024-04-16T12:57:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.855+0000 7f6c9e59c640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6c8006c8f0 0x7f6c8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.855+0000 7f6c9e59c640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6c8006c8f0 0x7f6c8006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c90008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:46.859+0000 7f6c977fe640 1 -- 172.21.15.106:0/716632548 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c8805a350 con 0x7f6ca00b7dd0 2024-04-16T12:57:47.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.040+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ca009acc0 con 0x7f6ca00b7dd0 2024-04-16T12:57:47.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.041+0000 7f6c977fe640 1 -- 172.21.15.106:0/716632548 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f6c88059c50 con 0x7f6ca00b7dd0 2024-04-16T12:57:47.042 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:47.043 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6c8006c8f0 msgr2=0x7f6c8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6c8006c8f0 0x7f6c8006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c90008030 comp rx=0 tx=0).stop 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca00b7dd0 msgr2=0x7f6ca00b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca00b7dd0 0x7f6ca00b53d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c7f0 tx=0x7f6c8800ccb0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 shutdown_connections 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6c8006c8f0 0x7f6c8006edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ca0141bf0 0x7f6ca01e0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca00b7dd0 0x7f6ca00b53d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 --2- 172.21.15.106:0/716632548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ca006bff0 0x7f6ca00b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 >> 172.21.15.106:0/716632548 conn(0x7f6ca00bd450 msgr2=0x7f6ca00ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:47.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 shutdown_connections 2024-04-16T12:57:47.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.043+0000 7f6c9f59e640 1 -- 172.21.15.106:0/716632548 wait complete. 2024-04-16T12:57:47.056 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T12:57:47.056 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:47.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.157+0000 7f1d353aa640 1 Processor -- start 2024-04-16T12:57:47.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.157+0000 7f1d353aa640 1 -- start start 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d353aa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1d3014b340 0x7f1d30073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d353aa640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1d30141ad0 0x7f1d30141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d353aa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d300bb240 con 0x7f1d30071cf0 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d353aa640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f1d30073280 con 0x7f1d30141ad0 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d353aa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1d300720d0 con 0x7f1d3014b340 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2effd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1d30071cf0 0x7f1d300b0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50796/0 (socket says 172.21.15.106:50796) 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2effd640 1 -- 172.21.15.106:0/671734573 learned_addr learned my addr 172.21.15.106:0/671734573 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2f7fe640 1 --2- 172.21.15.106:0/671734573 >> v2:172.21.15.106:3300/0 conn(0x7f1d30141ad0 0x7f1d30141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2e7fc640 1 --2- 172.21.15.106:0/671734573 >> v2:172.21.15.171:3300/0 conn(0x7f1d3014b340 0x7f1d30073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2dffb640 1 -- 172.21.15.106:0/671734573 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920057064 0 0) 0x7f1d300bb240 con 0x7f1d30071cf0 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2dffb640 1 -- 172.21.15.106:0/671734573 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d1c003520 con 0x7f1d30071cf0 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2f7fe640 1 -- 172.21.15.106:0/671734573 >> v2:172.21.15.171:3300/0 conn(0x7f1d3014b340 msgr2=0x7f1d30073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2f7fe640 1 --2- 172.21.15.106:0/671734573 >> v2:172.21.15.171:3300/0 conn(0x7f1d3014b340 0x7f1d30073af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2f7fe640 1 -- 172.21.15.106:0/671734573 >> v1:172.21.15.106:6789/0 conn(0x7f1d30071cf0 legacy=0x7f1d300b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.158+0000 7f1d2f7fe640 1 -- 172.21.15.106:0/671734573 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d300bac80 con 0x7f1d30141ad0 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.159+0000 7f1d2f7fe640 1 --2- 172.21.15.106:0/671734573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30141f00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d301459e0 tx=0x7f1d2802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce5167e14bca1f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.159+0000 7f1d2dffb640 1 -- 172.21.15.106:0/671734573 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28038070 con 0x7f1d30141ad0 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.159+0000 7f1d2dffb640 1 -- 172.21.15.106:0/671734573 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d28031710 con 0x7f1d30141ad0 2024-04-16T12:57:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.159+0000 7f1d2dffb640 1 -- 172.21.15.106:0/671734573 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28031ae0 con 0x7f1d30141ad0 2024-04-16T12:57:47.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 -- 172.21.15.106:0/671734573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 msgr2=0x7f1d30141f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 --2- 172.21.15.106:0/671734573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30141f00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d301459e0 tx=0x7f1d2802b7b0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 -- 172.21.15.106:0/671734573 shutdown_connections 2024-04-16T12:57:47.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 --2- 172.21.15.106:0/671734573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30141f00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 --2- 172.21.15.106:0/671734573 >> v2:172.21.15.171:3300/0 conn(0x7f1d3014b340 0x7f1d30073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 -- 172.21.15.106:0/671734573 >> 172.21.15.106:0/671734573 conn(0x7f1d3006d150 msgr2=0x7f1d300ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:47.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 -- 172.21.15.106:0/671734573 shutdown_connections 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.160+0000 7f1d353aa640 1 -- 172.21.15.106:0/671734573 wait complete. 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.161+0000 7f1d353aa640 1 Processor -- start 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.161+0000 7f1d353aa640 1 -- start start 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d353aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d30071cf0 0x7f1d300b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d353aa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d353aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d3014b340 0x7f1d301e0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d353aa640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1d301425c0 con 0x7f1d30141ad0 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d353aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d30142440 con 0x7f1d30071cf0 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d353aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1d30152670 con 0x7f1d3014b340 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30138f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33802/0 (socket says 172.21.15.106:33802) 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 -- 172.21.15.106:0/1895655885 learned_addr learned my addr 172.21.15.106:0/1895655885 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2effd640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d30071cf0 0x7f1d300b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2f7fe640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d3014b340 0x7f1d301e0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 -- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d3014b340 msgr2=0x7f1d301e0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d3014b340 0x7f1d301e0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 -- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d30071cf0 msgr2=0x7f1d300b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d30071cf0 0x7f1d300b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 -- 172.21.15.106:0/1895655885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d300b8ce0 con 0x7f1d30141ad0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d2e7fc640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30138f30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800e9b0 tx=0x7f1d1800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d277fe640 1 -- 172.21.15.106:0/1895655885 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18017070 con 0x7f1d30141ad0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.162+0000 7f1d277fe640 1 -- 172.21.15.106:0/1895655885 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d1800c9a0 con 0x7f1d30141ad0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.163+0000 7f1d277fe640 1 -- 172.21.15.106:0/1895655885 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1800cd90 con 0x7f1d30141ad0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.163+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d300b9680 con 0x7f1d30141ad0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.163+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d30136b40 con 0x7f1d30141ad0 2024-04-16T12:57:47.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.164+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3014b7d0 con 0x7f1d30141ad0 2024-04-16T12:57:47.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.164+0000 7f1d277fe640 1 -- 172.21.15.106:0/1895655885 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d1801a070 con 0x7f1d30141ad0 2024-04-16T12:57:47.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.164+0000 7f1d277fe640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d1006c8f0 0x7f1d1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.165+0000 7f1d2effd640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d1006c8f0 0x7f1d1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.165+0000 7f1d277fe640 1 -- 172.21.15.106:0/1895655885 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d1808be70 con 0x7f1d30141ad0 2024-04-16T12:57:47.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.165+0000 7f1d2effd640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d1006c8f0 0x7f1d1006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005c00 tx=0x7f1d20009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.169+0000 7f1d277fe640 1 -- 172.21.15.106:0/1895655885 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d3014b7d0 con 0x7f1d30141ad0 2024-04-16T12:57:47.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.379+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d300691a0 con 0x7f1d30141ad0 2024-04-16T12:57:47.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.379+0000 7f1d277fe640 1 -- 172.21.15.106:0/1895655885 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f1d18059c50 con 0x7f1d30141ad0 2024-04-16T12:57:47.381 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:47.381 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:47.381 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d1006c8f0 msgr2=0x7f1d1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d1006c8f0 0x7f1d1006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005c00 tx=0x7f1d20009040 comp rx=0 tx=0).stop 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 msgr2=0x7f1d30138f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30138f30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800e9b0 tx=0x7f1d1800ee70 comp rx=0 tx=0).stop 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 shutdown_connections 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d1006c8f0 0x7f1d1006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d3014b340 0x7f1d301e0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d30141ad0 0x7f1d30138f30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 --2- 172.21.15.106:0/1895655885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d30071cf0 0x7f1d300b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 >> 172.21.15.106:0/1895655885 conn(0x7f1d3006d150 msgr2=0x7f1d30145d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:47.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 shutdown_connections 2024-04-16T12:57:47.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.381+0000 7f1d353aa640 1 -- 172.21.15.106:0/1895655885 wait complete. 2024-04-16T12:57:47.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:57:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.494+0000 7ff3bab9d640 1 Processor -- start 2024-04-16T12:57:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.494+0000 7ff3bab9d640 1 -- start start 2024-04-16T12:57:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3bab9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff3b40bbe20 0x7ff3b40b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3bab9d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b40b3a80 con 0x7ff3b41400c0 2024-04-16T12:57:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3bab9d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b40bc200 con 0x7ff3b41490c0 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3bab9d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b40b7cb0 con 0x7ff3b40bbe20 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b8939640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff3b40bbe20 0x7ff3b40b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b8939640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff3b40bbe20 0x7ff3b40b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33818/0 (socket says 172.21.15.106:33818) 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b913a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff3b41400c0 0x7ff3b4150410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50812/0 (socket says 172.21.15.106:50812) 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b8939640 1 -- 172.21.15.106:0/797622526 learned_addr learned my addr 172.21.15.106:0/797622526 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b8939640 1 -- 172.21.15.106:0/797622526 >> v1:172.21.15.171:6789/0 conn(0x7ff3b41490c0 legacy=0x7ff3b413f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b8939640 1 -- 172.21.15.106:0/797622526 >> v1:172.21.15.106:6789/0 conn(0x7ff3b41400c0 legacy=0x7ff3b4150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b8939640 1 -- 172.21.15.106:0/797622526 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b40b42b0 con 0x7ff3b40bbe20 2024-04-16T12:57:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.495+0000 7ff3b37fe640 1 -- 172.21.15.106:0/797622526 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2792687625 0 0) 0x7ff3b40b3a80 con 0x7ff3b41400c0 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.496+0000 7ff3b8939640 1 --2- 172.21.15.106:0/797622526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b40bbe20 0x7ff3b40b2970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009870 tx=0x7ff3a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a392d9b1eddb76c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.496+0000 7ff3b37fe640 1 -- 172.21.15.106:0/797622526 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4035020 con 0x7ff3b40bbe20 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.496+0000 7ff3b37fe640 1 -- 172.21.15.106:0/797622526 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a4031870 con 0x7ff3b40bbe20 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.496+0000 7ff3b37fe640 1 -- 172.21.15.106:0/797622526 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4031c40 con 0x7ff3b40bbe20 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.497+0000 7ff3bab9d640 1 -- 172.21.15.106:0/797622526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b40bbe20 msgr2=0x7ff3b40b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.497+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/797622526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b40bbe20 0x7ff3b40b2970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009870 tx=0x7ff3a402b910 comp rx=0 tx=0).stop 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.497+0000 7ff3bab9d640 1 -- 172.21.15.106:0/797622526 shutdown_connections 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.497+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/797622526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b40bbe20 0x7ff3b40b2970 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.497+0000 7ff3bab9d640 1 -- 172.21.15.106:0/797622526 >> 172.21.15.106:0/797622526 conn(0x7ff3b4067e20 msgr2=0x7ff3b40bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.497+0000 7ff3bab9d640 1 -- 172.21.15.106:0/797622526 shutdown_connections 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.497+0000 7ff3bab9d640 1 -- 172.21.15.106:0/797622526 wait complete. 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.498+0000 7ff3bab9d640 1 Processor -- start 2024-04-16T12:57:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.498+0000 7ff3bab9d640 1 -- start start 2024-04-16T12:57:47.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3bab9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3b40bbe20 0x7ff3b4148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3bab9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3b41400c0 0x7ff3b41439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3bab9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b41490c0 0x7ff3b41deb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3bab9d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b40b4ab0 con 0x7ff3b41490c0 2024-04-16T12:57:47.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3bab9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b40b7960 con 0x7ff3b41400c0 2024-04-16T12:57:47.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3bab9d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b41d0d30 con 0x7ff3b40bbe20 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b41490c0 0x7ff3b41deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b41490c0 0x7ff3b41deb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33824/0 (socket says 172.21.15.106:33824) 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 -- 172.21.15.106:0/2656513786 learned_addr learned my addr 172.21.15.106:0/2656513786 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b8939640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3b40bbe20 0x7ff3b4148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b3fff640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3b41400c0 0x7ff3b41439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 -- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3b40bbe20 msgr2=0x7ff3b4148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3b40bbe20 0x7ff3b4148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 -- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3b41400c0 msgr2=0x7ff3b41439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3b41400c0 0x7ff3b41439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 -- 172.21.15.106:0/2656513786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b41d11c0 con 0x7ff3b41490c0 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b8939640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3b40bbe20 0x7ff3b4148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b3fff640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3b41400c0 0x7ff3b41439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b913a640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b41490c0 0x7ff3b41deb30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c7a0 tx=0x7ff3ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b17fa640 1 -- 172.21.15.106:0/2656513786 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac018070 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b17fa640 1 -- 172.21.15.106:0/2656513786 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac00a640 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3b17fa640 1 -- 172.21.15.106:0/2656513786 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00aa70 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.499+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b41d06e0 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.500+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b4144f70 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.501+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b40691a0 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.501+0000 7ff3b17fa640 1 -- 172.21.15.106:0/2656513786 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3ac01b070 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.501+0000 7ff3b17fa640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff3a006c8f0 0x7ff3a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.501+0000 7ff3b8939640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff3a006c8f0 0x7ff3a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.501+0000 7ff3b17fa640 1 -- 172.21.15.106:0/2656513786 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3ac08b050 con 0x7ff3b41490c0 2024-04-16T12:57:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.502+0000 7ff3b8939640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff3a006c8f0 0x7ff3a006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4036000 tx=0x7ff3a403c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.506+0000 7ff3b17fa640 1 -- 172.21.15.106:0/2656513786 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3ac059510 con 0x7ff3b41490c0 2024-04-16T12:57:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.718+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3b413e9e0 con 0x7ff3b41490c0 2024-04-16T12:57:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.719+0000 7ff3b17fa640 1 -- 172.21.15.106:0/2656513786 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7ff3ac058e10 con 0x7ff3b41490c0 2024-04-16T12:57:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:47.721 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1874634985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1874634985},{"type":"v1","addr":"172.21.15.171:6833","nonce":1874634985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:18.241720+0000","modified":"2024-04-16T12:57:20.236166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/1351002879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1351002879},{"type":"v1","addr":"172.21.15.106:6835","nonce":1351002879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-16T12:57:47.721 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff3a006c8f0 msgr2=0x7ff3a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff3a006c8f0 0x7ff3a006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4036000 tx=0x7ff3a403c040 comp rx=0 tx=0).stop 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b41490c0 msgr2=0x7ff3b41deb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b41490c0 0x7ff3b41deb30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c7a0 tx=0x7ff3ac00cc60 comp rx=0 tx=0).stop 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 shutdown_connections 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff3a006c8f0 0x7ff3a006edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3b41490c0 0x7ff3b41deb30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3b41400c0 0x7ff3b41439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 --2- 172.21.15.106:0/2656513786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3b40bbe20 0x7ff3b4148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 >> 172.21.15.106:0/2656513786 conn(0x7ff3b4067e20 msgr2=0x7ff3b40b6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 shutdown_connections 2024-04-16T12:57:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.721+0000 7ff3bab9d640 1 -- 172.21.15.106:0/2656513786 wait complete. 2024-04-16T12:57:47.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:47.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.835+0000 7fc46af32640 1 Processor -- start 2024-04-16T12:57:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.835+0000 7fc46af32640 1 -- start start 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.835+0000 7fc46af32640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc4640b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.835+0000 7fc46af32640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc4641446a0 0x7fc464144b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.835+0000 7fc46af32640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc464145040 con 0x7fc4640b4a50 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.835+0000 7fc46af32640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc4640b3fc0 con 0x7fc4641446a0 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.835+0000 7fc46af32640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4640b9720 con 0x7fc4640afee0 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc45bfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc4640b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc4694cf640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc4641446a0 0x7fc464144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc4694cf640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc4641446a0 0x7fc464144b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:46606/0 (socket says 172.21.15.106:46606) 2024-04-16T12:57:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc468cce640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc4640b4a50 0x7fc46409d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53500/0 (socket says 172.21.15.106:53500) 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc45bfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc4640b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:57806/0 (socket says 172.21.15.106:57806) 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc4694cf640 1 -- 172.21.15.106:0/4062310248 learned_addr learned my addr 172.21.15.106:0/4062310248 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc45bfff640 1 -- 172.21.15.106:0/4062310248 >> v2:172.21.15.171:3300/0 conn(0x7fc4641446a0 msgr2=0x7fc464144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc45bfff640 1 --2- 172.21.15.106:0/4062310248 >> v2:172.21.15.171:3300/0 conn(0x7fc4641446a0 0x7fc464144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc45bfff640 1 -- 172.21.15.106:0/4062310248 >> v1:172.21.15.171:6789/0 conn(0x7fc4640b4a50 legacy=0x7fc46409d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc45bfff640 1 -- 172.21.15.106:0/4062310248 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640b9a00 con 0x7fc4640afee0 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc45b7fe640 1 -- 172.21.15.106:0/4062310248 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725998513 0 0) 0x7fc464145040 con 0x7fc4640b4a50 2024-04-16T12:57:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.836+0000 7fc4694cf640 1 --2- 172.21.15.106:0/4062310248 >> v2:172.21.15.171:3300/0 conn(0x7fc4641446a0 0x7fc464144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:47.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.837+0000 7fc45bfff640 1 --2- 172.21.15.106:0/4062310248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc4640b0340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4540097a0 tx=0x7fc45402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3771733b1556f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.837+0000 7fc45b7fe640 1 -- 172.21.15.106:0/4062310248 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454038070 con 0x7fc4640afee0 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.837+0000 7fc45b7fe640 1 -- 172.21.15.106:0/4062310248 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc454031700 con 0x7fc4640afee0 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.837+0000 7fc45b7fe640 1 -- 172.21.15.106:0/4062310248 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454031ad0 con 0x7fc4640afee0 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 -- 172.21.15.106:0/4062310248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 msgr2=0x7fc4640b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 --2- 172.21.15.106:0/4062310248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc4640b0340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4540097a0 tx=0x7fc45402b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 -- 172.21.15.106:0/4062310248 shutdown_connections 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 --2- 172.21.15.106:0/4062310248 >> v2:172.21.15.171:3300/0 conn(0x7fc4641446a0 0x7fc464144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 --2- 172.21.15.106:0/4062310248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc4640b0340 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 -- 172.21.15.106:0/4062310248 >> 172.21.15.106:0/4062310248 conn(0x7fc46409cc10 msgr2=0x7fc46406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 -- 172.21.15.106:0/4062310248 shutdown_connections 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.838+0000 7fc46af32640 1 -- 172.21.15.106:0/4062310248 wait complete. 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 Processor -- start 2024-04-16T12:57:47.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 -- start start 2024-04-16T12:57:47.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc46413f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4640b4a50 0x7fc4641db440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4641446a0 0x7fc4641db980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc46406d890 con 0x7fc4640b4a50 2024-04-16T12:57:47.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4640b93b0 con 0x7fc4641446a0 2024-04-16T12:57:47.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.839+0000 7fc46af32640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc46406da10 con 0x7fc4640afee0 2024-04-16T12:57:47.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4640b4a50 0x7fc4641db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4640b4a50 0x7fc4641db440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33826/0 (socket says 172.21.15.106:33826) 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 -- 172.21.15.106:0/3761065840 learned_addr learned my addr 172.21.15.106:0/3761065840 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc4694cf640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4641446a0 0x7fc4641db980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc468cce640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc46413f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 -- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 msgr2=0x7fc46413f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc46413f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 -- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4641446a0 msgr2=0x7fc4641db980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4641446a0 0x7fc4641db980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 -- 172.21.15.106:0/3761065840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640b2cb0 con 0x7fc4640b4a50 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc45bfff640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4640b4a50 0x7fc4641db440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc4540097a0 tx=0x7fc4540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc4597fa640 1 -- 172.21.15.106:0/3761065840 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454038040 con 0x7fc4640b4a50 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc4597fa640 1 -- 172.21.15.106:0/3761065840 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc454004030 con 0x7fc4640b4a50 2024-04-16T12:57:47.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4640b1c00 con 0x7fc4640b4a50 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc4597fa640 1 -- 172.21.15.106:0/3761065840 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454004420 con 0x7fc4640b4a50 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.840+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4640b1420 con 0x7fc4640b4a50 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.841+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc464068a90 con 0x7fc4640b4a50 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.842+0000 7fc4597fa640 1 -- 172.21.15.106:0/3761065840 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc454033780 con 0x7fc4640b4a50 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.842+0000 7fc4597fa640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc45006c8f0 0x7fc45006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.842+0000 7fc4597fa640 1 -- 172.21.15.106:0/3761065840 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc4540adcd0 con 0x7fc4640b4a50 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.842+0000 7fc468cce640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc45006c8f0 0x7fc45006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.843+0000 7fc468cce640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc45006c8f0 0x7fc45006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc460000f60 tx=0x7fc460007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:47.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:47.846+0000 7fc4597fa640 1 -- 172.21.15.106:0/3761065840 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4640b1c00 con 0x7fc4640b4a50 2024-04-16T12:57:48.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.024+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc464144e60 con 0x7fc4640b4a50 2024-04-16T12:57:48.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.025+0000 7fc4597fa640 1 -- 172.21.15.106:0/3761065840 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fc454030070 con 0x7fc4640b4a50 2024-04-16T12:57:48.027 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:48.027 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:19.888429+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:16.202733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:17.194394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:48.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc45006c8f0 msgr2=0x7fc45006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc45006c8f0 0x7fc45006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc460000f60 tx=0x7fc460007d50 comp rx=0 tx=0).stop 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4640b4a50 msgr2=0x7fc4641db440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4640b4a50 0x7fc4641db440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc4540097a0 tx=0x7fc4540046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 shutdown_connections 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc45006c8f0 0x7fc45006edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4641446a0 0x7fc4641db980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4640b4a50 0x7fc4641db440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 --2- 172.21.15.106:0/3761065840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4640afee0 0x7fc46413f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 >> 172.21.15.106:0/3761065840 conn(0x7fc46409cc10 msgr2=0x7fc464074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 shutdown_connections 2024-04-16T12:57:48.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.027+0000 7fc46af32640 1 -- 172.21.15.106:0/3761065840 wait complete. 2024-04-16T12:57:48.040 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T12:57:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.141+0000 7fc99d1fa640 1 Processor -- start 2024-04-16T12:57:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.141+0000 7fc99d1fa640 1 -- start start 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99d1fa640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9980679d0 0x7fc9980b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99d1fa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9980b0ac0 0x7fc9980afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99d1fa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc998067db0 con 0x7fc99809fb60 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99d1fa640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc9980b45f0 con 0x7fc9980679d0 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99d1fa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980b01c0 con 0x7fc9980b0ac0 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc996d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9980679d0 0x7fc9980b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99759e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc99809fb60 0x7fc998144d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50826/0 (socket says 172.21.15.106:50826) 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99759e640 1 -- 172.21.15.106:0/2732923655 learned_addr learned my addr 172.21.15.106:0/2732923655 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc98e59c640 1 --2- 172.21.15.106:0/2732923655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9980b0ac0 0x7fc9980afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc996d9d640 1 -- 172.21.15.106:0/2732923655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9980b0ac0 msgr2=0x7fc9980afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc996d9d640 1 --2- 172.21.15.106:0/2732923655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9980b0ac0 0x7fc9980afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc996d9d640 1 -- 172.21.15.106:0/2732923655 >> v1:172.21.15.106:6789/0 conn(0x7fc99809fb60 legacy=0x7fc998144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc99659c640 1 -- 172.21.15.106:0/2732923655 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028094653 0 0) 0x7fc998067db0 con 0x7fc99809fb60 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc996d9d640 1 -- 172.21.15.106:0/2732923655 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9980b5b10 con 0x7fc9980679d0 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.142+0000 7fc98e59c640 1 --2- 172.21.15.106:0/2732923655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9980b0ac0 0x7fc9980afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.143+0000 7fc996d9d640 1 --2- 172.21.15.106:0/2732923655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980679d0 0x7fc9980b4a80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc9880097a0 tx=0x7fc98802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe4fbe6051836e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.143+0000 7fc99659c640 1 -- 172.21.15.106:0/2732923655 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988035020 con 0x7fc9980679d0 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.143+0000 7fc99659c640 1 -- 172.21.15.106:0/2732923655 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc988031830 con 0x7fc9980679d0 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.143+0000 7fc99659c640 1 -- 172.21.15.106:0/2732923655 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988031c00 con 0x7fc9980679d0 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 -- 172.21.15.106:0/2732923655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980679d0 msgr2=0x7fc9980b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/2732923655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980679d0 0x7fc9980b4a80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc9880097a0 tx=0x7fc98802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 -- 172.21.15.106:0/2732923655 shutdown_connections 2024-04-16T12:57:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/2732923655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9980b0ac0 0x7fc9980afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/2732923655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980679d0 0x7fc9980b4a80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 -- 172.21.15.106:0/2732923655 >> 172.21.15.106:0/2732923655 conn(0x7fc9980b9ca0 msgr2=0x7fc9980ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 -- 172.21.15.106:0/2732923655 shutdown_connections 2024-04-16T12:57:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.144+0000 7fc99d1fa640 1 -- 172.21.15.106:0/2732923655 wait complete. 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.145+0000 7fc99d1fa640 1 Processor -- start 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.145+0000 7fc99d1fa640 1 -- start start 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9980679d0 0x7fc998142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99809fb60 0x7fc9981461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980b0ac0 0x7fc998146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc998145450 con 0x7fc9980b0ac0 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980b57d0 con 0x7fc9980679d0 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9981455d0 con 0x7fc99809fb60 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980b0ac0 0x7fc998146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980b0ac0 0x7fc998146710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33850/0 (socket says 172.21.15.106:33850) 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 -- 172.21.15.106:0/1152389122 learned_addr learned my addr 172.21.15.106:0/1152389122 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc98e59c640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99809fb60 0x7fc9981461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc996d9d640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9980679d0 0x7fc998142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 -- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99809fb60 msgr2=0x7fc9981461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99809fb60 0x7fc9981461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 -- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9980679d0 msgr2=0x7fc998142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9980679d0 0x7fc998142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 -- 172.21.15.106:0/1152389122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9980b1fa0 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99759e640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980b0ac0 0x7fc998146710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c7b0 tx=0x7fc99000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc98ffff640 1 -- 172.21.15.106:0/1152389122 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990018070 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc98ffff640 1 -- 172.21.15.106:0/1152389122 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99000a640 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9980b0ec0 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc98ffff640 1 -- 172.21.15.106:0/1152389122 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99000aa70 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.146+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9981485c0 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.148+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9980b9800 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.148+0000 7fc98ffff640 1 -- 172.21.15.106:0/1152389122 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc99001b070 con 0x7fc9980b0ac0 2024-04-16T12:57:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.148+0000 7fc98ffff640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc97806c8f0 0x7fc97806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.149+0000 7fc98ffff640 1 -- 172.21.15.106:0/1152389122 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc99008aff0 con 0x7fc9980b0ac0 2024-04-16T12:57:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.149+0000 7fc996d9d640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc97806c8f0 0x7fc97806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.149+0000 7fc996d9d640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc97806c8f0 0x7fc97806edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc988036000 tx=0x7fc988008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.153+0000 7fc98ffff640 1 -- 172.21.15.106:0/1152389122 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9980b9800 con 0x7fc9980b0ac0 2024-04-16T12:57:48.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.366+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc998068a90 con 0x7fc9980b0ac0 2024-04-16T12:57:48.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-16T12:57:48.366+0000 7f7014385640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T12:57:48.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.368+0000 7fc98ffff640 1 -- 172.21.15.106:0/1152389122 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fc990058e60 con 0x7fc9980b0ac0 2024-04-16T12:57:48.369 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc97806c8f0 msgr2=0x7fc97806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc97806c8f0 0x7fc97806edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc988036000 tx=0x7fc988008030 comp rx=0 tx=0).stop 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980b0ac0 msgr2=0x7fc998146710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980b0ac0 0x7fc998146710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c7b0 tx=0x7fc99000cc70 comp rx=0 tx=0).stop 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 shutdown_connections 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc97806c8f0 0x7fc97806edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9980b0ac0 0x7fc998146710 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99809fb60 0x7fc9981461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 --2- 172.21.15.106:0/1152389122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9980679d0 0x7fc998142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 >> 172.21.15.106:0/1152389122 conn(0x7fc9980b9ca0 msgr2=0x7fc998070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:48.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 shutdown_connections 2024-04-16T12:57:48.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.371+0000 7fc99d1fa640 1 -- 172.21.15.106:0/1152389122 wait complete. 2024-04-16T12:57:48.374 INFO:tasks.ceph.mds.a.smithi106.stderr: -1143> 2024-04-16T12:57:21.766+0000 7f666e1df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T12:57:48.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T12:57:48.399 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-04-16T12:57:48.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.488+0000 7f591ea88640 1 Processor -- start 2024-04-16T12:57:48.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591ea88640 1 -- start start 2024-04-16T12:57:48.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591ea88640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59181401d0 0x7f59180b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591ea88640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59180b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591ea88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59180b4000 con 0x7f59180b4960 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591ea88640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f59180b70c0 con 0x7f59181401d0 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591ea88640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f59180b2aa0 con 0x7f59180b6c50 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591c824640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59181401d0 0x7f59180b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591c824640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59181401d0 0x7f59180b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33876/0 (socket says 172.21.15.106:33876) 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f591c824640 1 -- 172.21.15.106:0/2100824828 learned_addr learned my addr 172.21.15.106:0/2100824828 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.489+0000 7f5917fff640 1 --2- 172.21.15.106:0/2100824828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59180b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.490+0000 7f591c824640 1 -- 172.21.15.106:0/2100824828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 msgr2=0x7f59180b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.490+0000 7f591c824640 1 --2- 172.21.15.106:0/2100824828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59180b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.490+0000 7f591c824640 1 -- 172.21.15.106:0/2100824828 >> v1:172.21.15.171:6789/0 conn(0x7f59180b4960 legacy=0x7f59181493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.490+0000 7f591c824640 1 -- 172.21.15.106:0/2100824828 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59180b2d80 con 0x7f59181401d0 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.490+0000 7f591c824640 1 --2- 172.21.15.106:0/2100824828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f59180b6710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f590c009870 tx=0x7f590c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd02c1cb4bfa9a84 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f59177fe640 1 -- 172.21.15.106:0/2100824828 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c035020 con 0x7f59181401d0 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f59177fe640 1 -- 172.21.15.106:0/2100824828 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c031640 con 0x7f59181401d0 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f59177fe640 1 -- 172.21.15.106:0/2100824828 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c02d040 con 0x7f59181401d0 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 -- 172.21.15.106:0/2100824828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 msgr2=0x7f59180b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 --2- 172.21.15.106:0/2100824828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f59180b6710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f590c009870 tx=0x7f590c02b8f0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 -- 172.21.15.106:0/2100824828 shutdown_connections 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 --2- 172.21.15.106:0/2100824828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59180b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 --2- 172.21.15.106:0/2100824828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f59180b6710 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 -- 172.21.15.106:0/2100824828 >> 172.21.15.106:0/2100824828 conn(0x7f5918068140 msgr2=0x7f59180b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:48.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 -- 172.21.15.106:0/2100824828 shutdown_connections 2024-04-16T12:57:48.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.491+0000 7f591ea88640 1 -- 172.21.15.106:0/2100824828 wait complete. 2024-04-16T12:57:48.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.492+0000 7f591ea88640 1 Processor -- start 2024-04-16T12:57:48.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.492+0000 7f591ea88640 1 -- start start 2024-04-16T12:57:48.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591ea88640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59180b4960 0x7f59181dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591ea88640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59181dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591ea88640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f5918133140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591ea88640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f59180b4f10 con 0x7f59181401d0 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591ea88640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f59180b4d90 con 0x7f59180b4960 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591ea88640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f59180b52f0 con 0x7f59180b6c50 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f5918133140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f5918133140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33880/0 (socket says 172.21.15.106:33880) 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 -- 172.21.15.106:0/983098166 learned_addr learned my addr 172.21.15.106:0/983098166 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591c824640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59180b4960 0x7f59181dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f5917fff640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59181dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 -- 172.21.15.106:0/983098166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 msgr2=0x7f59181dbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59181dbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 -- 172.21.15.106:0/983098166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59180b4960 msgr2=0x7f59181dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59180b4960 0x7f59181dfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:48.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.493+0000 7f591d025640 1 -- 172.21.15.106:0/983098166 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59181df210 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.494+0000 7f591d025640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f5918133140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f591000c6b0 tx=0x7f591000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.494+0000 7f59157fa640 1 -- 172.21.15.106:0/983098166 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910003b70 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.494+0000 7f59157fa640 1 -- 172.21.15.106:0/983098166 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5910003d30 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.494+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59181df4f0 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.494+0000 7f59157fa640 1 -- 172.21.15.106:0/983098166 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910005310 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.494+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5918134020 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.495+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59180b7970 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.495+0000 7f59157fa640 1 -- 172.21.15.106:0/983098166 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59100054b0 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.496+0000 7f59157fa640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f58fc06c8f0 0x7f58fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.496+0000 7f59157fa640 1 -- 172.21.15.106:0/983098166 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f591008b930 con 0x7f59181401d0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.496+0000 7f591c824640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f58fc06c8f0 0x7f58fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:48.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.496+0000 7f591c824640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f58fc06c8f0 0x7f58fc06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f590c036000 tx=0x7f590c03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:48.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.500+0000 7f59157fa640 1 -- 172.21.15.106:0/983098166 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59180b7970 con 0x7f59181401d0 2024-04-16T12:57:48.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:48.717+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f59180754f0 con 0x7f59181401d0 2024-04-16T12:57:48.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:48.806 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:49.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.369+0000 7f59157fa640 1 -- 172.21.15.106:0/983098166 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f59180754f0 con 0x7f59181401d0 2024-04-16T12:57:49.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.372+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f58fc06c8f0 msgr2=0x7f58fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:49.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.372+0000 7f591ea88640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f58fc06c8f0 0x7f58fc06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f590c036000 tx=0x7f590c03c040 comp rx=0 tx=0).stop 2024-04-16T12:57:49.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 msgr2=0x7f5918133140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f5918133140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f591000c6b0 tx=0x7f591000cb70 comp rx=0 tx=0).stop 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 shutdown_connections 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f58fc06c8f0 0x7f58fc06edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59181401d0 0x7f5918133140 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59180b6c50 0x7f59181dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 --2- 172.21.15.106:0/983098166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59180b4960 0x7f59181dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 >> 172.21.15.106:0/983098166 conn(0x7f5918068140 msgr2=0x7f591813c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 shutdown_connections 2024-04-16T12:57:49.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.373+0000 7f591ea88640 1 -- 172.21.15.106:0/983098166 wait complete. 2024-04-16T12:57:49.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T12:57:49.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.497+0000 7f7ab2d49640 1 Processor -- start 2024-04-16T12:57:49.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.497+0000 7f7ab2d49640 1 -- start start 2024-04-16T12:57:49.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.497+0000 7f7ab2d49640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7aac0af140 0x7f7aac150490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.497+0000 7f7ab2d49640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aac0b0160 con 0x7f7aac0ae350 2024-04-16T12:57:49.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.497+0000 7f7ab2d49640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aac0b5490 con 0x7f7aac0b50b0 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.497+0000 7f7ab2d49640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7aac144e60 con 0x7f7aac0af140 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aabfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7aac0ae350 0x7f7aac1452f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50856/0 (socket says 172.21.15.106:50856) 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aabfff640 1 -- 172.21.15.106:0/402834475 learned_addr learned my addr 172.21.15.106:0/402834475 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/402834475 >> v2:172.21.15.171:3300/0 conn(0x7f7aac0af140 0x7f7aac150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684161541 0 0) 0x7f7aac0b0160 con 0x7f7aac0ae350 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c003520 con 0x7f7aac0ae350 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676955637 0 0) 0x7f7aac0b5490 con 0x7f7aac0b50b0 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aac0b0160 con 0x7f7aac0b50b0 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317726455 0 0) 0x7f7a9c003520 con 0x7f7aac0ae350 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 >> v2:172.21.15.171:3300/0 conn(0x7f7aac0af140 msgr2=0x7f7aac150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 --2- 172.21.15.106:0/402834475 >> v2:172.21.15.171:3300/0 conn(0x7f7aac0af140 0x7f7aac150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 >> v1:172.21.15.171:6789/0 conn(0x7f7aac0b50b0 legacy=0x7f7aac073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac0ae870 con 0x7f7aac0ae350 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f7a98001670 con 0x7f7aac0ae350 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/402834475 >> v2:172.21.15.171:3300/0 conn(0x7f7aac0af140 0x7f7aac150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 >> v1:172.21.15.106:6789/0 conn(0x7f7aac0ae350 legacy=0x7f7aac1452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a9c003b40 0x7f7a9c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c004800 0x7f7a9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a9c0051c0 0x7f7a9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac144e60 con 0x7f7a9c0051c0 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c00c0f0 con 0x7f7a9c003b40 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9c00c2f0 con 0x7f7a9c004800 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a9c0051c0 0x7f7a9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7ab0ae5640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a9c003b40 0x7f7a9c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.498+0000 7f7aabfff640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c004800 0x7f7a9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7ab12e6640 1 -- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c004800 msgr2=0x7f7a9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c004800 0x7f7a9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7ab12e6640 1 -- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a9c003b40 msgr2=0x7f7a9c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a9c003b40 0x7f7a9c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7ab12e6640 1 -- 172.21.15.106:0/402834475 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c003520 con 0x7f7a9c0051c0 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7aabfff640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c004800 0x7f7a9c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7ab12e6640 1 -- 172.21.15.106:0/402834475 reap_dead start 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.499+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a9c0051c0 0x7f7a9c00b9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e320 tx=0x7f7a9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3654705369e3edaa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4009de0 con 0x7f7a9c0051c0 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa402cde0 con 0x7f7a9c0051c0 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7aab7fe640 1 -- 172.21.15.106:0/402834475 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4003bd0 con 0x7f7a9c0051c0 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7ab2d49640 1 -- 172.21.15.106:0/402834475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a9c0051c0 msgr2=0x7f7a9c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a9c0051c0 0x7f7a9c00b9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e320 tx=0x7f7a9c005830 comp rx=0 tx=0).stop 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7ab2d49640 1 -- 172.21.15.106:0/402834475 shutdown_connections 2024-04-16T12:57:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/402834475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a9c0051c0 0x7f7a9c00b9c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7ab2d49640 1 -- 172.21.15.106:0/402834475 >> 172.21.15.106:0/402834475 conn(0x7f7aac0b5e30 msgr2=0x7f7aac0b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7ab2d49640 1 -- 172.21.15.106:0/402834475 shutdown_connections 2024-04-16T12:57:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.500+0000 7f7ab2d49640 1 -- 172.21.15.106:0/402834475 wait complete. 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.501+0000 7f7ab2d49640 1 Processor -- start 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.501+0000 7f7ab2d49640 1 -- start start 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab2d49640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c0051c0 0x7f7aac0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab2d49640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac149ac0 0x7f7aac149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab2d49640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7aac1374d0 0x7f7aac137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab2d49640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac0737a0 con 0x7f7aac1374d0 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab2d49640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac073620 con 0x7f7aac149ac0 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab2d49640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7aac073920 con 0x7f7a9c0051c0 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab12e6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7aac1374d0 0x7f7aac137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab12e6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7aac1374d0 0x7f7aac137950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33904/0 (socket says 172.21.15.106:33904) 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab12e6640 1 -- 172.21.15.106:0/1112475431 learned_addr learned my addr 172.21.15.106:0/1112475431 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7aabfff640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac149ac0 0x7f7aac149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.502+0000 7f7ab0ae5640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c0051c0 0x7f7aac0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab12e6640 1 -- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c0051c0 msgr2=0x7f7aac0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c0051c0 0x7f7aac0b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab12e6640 1 -- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac149ac0 msgr2=0x7f7aac149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac149ac0 0x7f7aac149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab12e6640 1 -- 172.21.15.106:0/1112475431 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac14b170 con 0x7f7aac1374d0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab12e6640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7aac1374d0 0x7f7aac137950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402c850 tx=0x7f7aa4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7aa97fa640 1 -- 172.21.15.106:0/1112475431 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4009de0 con 0x7f7aac1374d0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7aa97fa640 1 -- 172.21.15.106:0/1112475431 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4044070 con 0x7f7aac1374d0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aac09dd70 con 0x7f7aac1374d0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7aa97fa640 1 -- 172.21.15.106:0/1112475431 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4004830 con 0x7f7aac1374d0 2024-04-16T12:57:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.503+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aac149570 con 0x7f7aac1374d0 2024-04-16T12:57:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.504+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aac1497a0 con 0x7f7aac1374d0 2024-04-16T12:57:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.504+0000 7f7aa97fa640 1 -- 172.21.15.106:0/1112475431 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7aa403d040 con 0x7f7aac1374d0 2024-04-16T12:57:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.505+0000 7f7aa97fa640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a9006ca90 0x7f7a9006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.505+0000 7f7aa97fa640 1 -- 172.21.15.106:0/1112475431 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f7aa40ae0d0 con 0x7f7aac1374d0 2024-04-16T12:57:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.505+0000 7f7ab0ae5640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a9006ca90 0x7f7a9006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.505+0000 7f7ab0ae5640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a9006ca90 0x7f7a9006ef50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.509+0000 7f7aa97fa640 1 -- 172.21.15.106:0/1112475431 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7aac1497a0 con 0x7f7aac1374d0 2024-04-16T12:57:49.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:49.690+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7aac068a90 con 0x7f7aac1374d0 2024-04-16T12:57:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.370+0000 7f7aa97fa640 1 -- 172.21.15.106:0/1112475431 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f7aa407c530 con 0x7f7aac1374d0 2024-04-16T12:57:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2024-04-16T12:57:50.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.373+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a9006ca90 msgr2=0x7f7a9006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:50.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.373+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a9006ca90 0x7f7a9006ef50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa0009040 comp rx=0 tx=0).stop 2024-04-16T12:57:50.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.373+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7aac1374d0 msgr2=0x7f7aac137950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.373+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7aac1374d0 0x7f7aac137950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402c850 tx=0x7f7aa4009750 comp rx=0 tx=0).stop 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 shutdown_connections 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a9006ca90 0x7f7a9006ef50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7aac1374d0 0x7f7aac137950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac149ac0 0x7f7aac149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 --2- 172.21.15.106:0/1112475431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a9c0051c0 0x7f7aac0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 >> 172.21.15.106:0/1112475431 conn(0x7f7aac0b5e30 msgr2=0x7f7aac0b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 shutdown_connections 2024-04-16T12:57:50.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.374+0000 7f7ab2d49640 1 -- 172.21.15.106:0/1112475431 wait complete. 2024-04-16T12:57:50.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T12:57:50.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.495+0000 7f8957932640 1 Processor -- start 2024-04-16T12:57:50.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.495+0000 7f8957932640 1 -- start start 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f8957932640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89500b50b0 0x7f89500737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f8957932640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f895006ea00 0x7f8950148670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f8957932640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895006e5a0 con 0x7f8950073d00 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f8957932640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f89500b5490 con 0x7f89500b50b0 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f8957932640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f89500aefd0 con 0x7f895006ea00 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f89556ce640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89500b50b0 0x7f89500737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f89556ce640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89500b50b0 0x7f89500737c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33912/0 (socket says 172.21.15.106:33912) 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f89556ce640 1 -- 172.21.15.106:0/558894989 learned_addr learned my addr 172.21.15.106:0/558894989 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f8954ecd640 1 --2- 172.21.15.106:0/558894989 >> v2:172.21.15.171:3300/0 conn(0x7f895006ea00 0x7f8950148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:50.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f89556ce640 1 -- 172.21.15.106:0/558894989 >> v2:172.21.15.171:3300/0 conn(0x7f895006ea00 msgr2=0x7f8950148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:50.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f89556ce640 1 --2- 172.21.15.106:0/558894989 >> v2:172.21.15.171:3300/0 conn(0x7f895006ea00 0x7f8950148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f89556ce640 1 -- 172.21.15.106:0/558894989 >> v1:172.21.15.171:6789/0 conn(0x7f8950073d00 legacy=0x7f8950144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:50.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f89556ce640 1 -- 172.21.15.106:0/558894989 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950148150 con 0x7f89500b50b0 2024-04-16T12:57:50.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.496+0000 7f8954ecd640 1 --2- 172.21.15.106:0/558894989 >> v2:172.21.15.171:3300/0 conn(0x7f895006ea00 0x7f8950148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.497+0000 7f89556ce640 1 --2- 172.21.15.106:0/558894989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89500b50b0 0x7f89500737c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f895009f250 tx=0x7f894c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2643ed6bd2ddca server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.497+0000 7f8947fff640 1 -- 172.21.15.106:0/558894989 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c035020 con 0x7f89500b50b0 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.497+0000 7f8947fff640 1 -- 172.21.15.106:0/558894989 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c031870 con 0x7f89500b50b0 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.497+0000 7f8947fff640 1 -- 172.21.15.106:0/558894989 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c031c40 con 0x7f89500b50b0 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 -- 172.21.15.106:0/558894989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89500b50b0 msgr2=0x7f89500737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 --2- 172.21.15.106:0/558894989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89500b50b0 0x7f89500737c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f895009f250 tx=0x7f894c02b910 comp rx=0 tx=0).stop 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 -- 172.21.15.106:0/558894989 shutdown_connections 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 --2- 172.21.15.106:0/558894989 >> v2:172.21.15.171:3300/0 conn(0x7f895006ea00 0x7f8950148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 --2- 172.21.15.106:0/558894989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89500b50b0 0x7f89500737c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 -- 172.21.15.106:0/558894989 >> 172.21.15.106:0/558894989 conn(0x7f89500b5e30 msgr2=0x7f89500b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:50.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 -- 172.21.15.106:0/558894989 shutdown_connections 2024-04-16T12:57:50.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.498+0000 7f8957932640 1 -- 172.21.15.106:0/558894989 wait complete. 2024-04-16T12:57:50.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.499+0000 7f8957932640 1 Processor -- start 2024-04-16T12:57:50.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.499+0000 7f8957932640 1 -- start start 2024-04-16T12:57:50.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.500+0000 7f8957932640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8950073d00 0x7f8950141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:50.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.500+0000 7f8957932640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89500b50b0 0x7f89501d82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:50.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.500+0000 7f8957932640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f895013f590 0x7f89501d8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.500+0000 7f8957932640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f89500aedb0 con 0x7f8950073d00 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.500+0000 7f8957932640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89500aec30 con 0x7f89500b50b0 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.500+0000 7f8957932640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89500ae350 con 0x7f895013f590 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.500+0000 7f89556ce640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8950073d00 0x7f8950141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8950073d00 0x7f8950141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33918/0 (socket says 172.21.15.106:33918) 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 -- 172.21.15.106:0/984638306 learned_addr learned my addr 172.21.15.106:0/984638306 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8954ecd640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89500b50b0 0x7f89501d82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8955ecf640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f895013f590 0x7f89501d8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 -- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f895013f590 msgr2=0x7f89501d8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f895013f590 0x7f89501d8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 -- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89500b50b0 msgr2=0x7f89501d82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89500b50b0 0x7f89501d82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 -- 172.21.15.106:0/984638306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89501418a0 con 0x7f8950073d00 2024-04-16T12:57:50.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8954ecd640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89500b50b0 0x7f89501d82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:50.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f89556ce640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8950073d00 0x7f8950141d30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f894c02b950 tx=0x7f894c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:50.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8945ffb640 1 -- 172.21.15.106:0/984638306 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c040070 con 0x7f8950073d00 2024-04-16T12:57:50.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8945ffb640 1 -- 172.21.15.106:0/984638306 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c030d00 con 0x7f8950073d00 2024-04-16T12:57:50.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89501403e0 con 0x7f8950073d00 2024-04-16T12:57:50.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8945ffb640 1 -- 172.21.15.106:0/984638306 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c035040 con 0x7f8950073d00 2024-04-16T12:57:50.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.501+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89501415c0 con 0x7f8950073d00 2024-04-16T12:57:50.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.502+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8950068a90 con 0x7f8950073d00 2024-04-16T12:57:50.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.503+0000 7f8945ffb640 1 -- 172.21.15.106:0/984638306 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f894c04b060 con 0x7f8950073d00 2024-04-16T12:57:50.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.504+0000 7f8945ffb640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f893406c8f0 0x7f893406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:50.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.504+0000 7f8954ecd640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f893406c8f0 0x7f893406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:50.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.504+0000 7f8945ffb640 1 -- 172.21.15.106:0/984638306 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7f894c0ad750 con 0x7f8950073d00 2024-04-16T12:57:50.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.504+0000 7f8954ecd640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f893406c8f0 0x7f893406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f895013f010 tx=0x7f8940008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:50.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.508+0000 7f8945ffb640 1 -- 172.21.15.106:0/984638306 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f894c07bd70 con 0x7f8950073d00 2024-04-16T12:57:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:50.682+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f895006e100 con 0x7f8950073d00 2024-04-16T12:57:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.376+0000 7f8945ffb640 1 -- 172.21.15.106:0/984638306 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7f894c07b670 con 0x7f8950073d00 2024-04-16T12:57:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2024-04-16T12:57:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f893406c8f0 msgr2=0x7f893406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f893406c8f0 0x7f893406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f895013f010 tx=0x7f8940008040 comp rx=0 tx=0).stop 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8950073d00 msgr2=0x7f8950141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8950073d00 0x7f8950141d30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f894c02b950 tx=0x7f894c0046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 shutdown_connections 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f893406c8f0 0x7f893406edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f895013f590 0x7f89501d8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89500b50b0 0x7f89501d82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 --2- 172.21.15.106:0/984638306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8950073d00 0x7f8950141d30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 >> 172.21.15.106:0/984638306 conn(0x7f89500b5e30 msgr2=0x7f895006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 shutdown_connections 2024-04-16T12:57:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.378+0000 7f8957932640 1 -- 172.21.15.106:0/984638306 wait complete. 2024-04-16T12:57:51.392 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T12:57:51.392 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T12:57:51.392 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T12:57:51.392 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:57:51.392 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T12:57:51.392 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T12:57:51.393 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T12:57:51.393 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:57:51.401 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T12:57:51.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T12:57:51.404 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T12:57:51.405 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T12:57:51.444 INFO:tasks.ceph.mds.a:Started 2024-04-16T12:57:51.445 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:51.447 INFO:tasks.ceph.mds.b:Started 2024-04-16T12:57:51.447 DEBUG:teuthology.parallel:result is None 2024-04-16T12:57:51.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T12:57:51.523 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-04-16T12:57:51.530 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-04-16T12:57:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.552+0000 7f2567a33640 1 Processor -- start 2024-04-16T12:57:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.552+0000 7f2567a33640 1 -- start start 2024-04-16T12:57:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2567a33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25600b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2567a33640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25601481c0 0x7f25601418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2567a33640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2560148640 0x7f2560141de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2567a33640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f2560148b70 con 0x7f25601481c0 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2567a33640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f25600b4bd0 con 0x7f2560148640 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2567a33640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f25600b4eb0 con 0x7f25600b63a0 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2564fce640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25601481c0 0x7f25601418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2564fce640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25601481c0 0x7f25601418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33940/0 (socket says 172.21.15.106:33940) 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2564fce640 1 -- 172.21.15.106:0/3485293405 learned_addr learned my addr 172.21.15.106:0/3485293405 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f25657cf640 1 --2- 172.21.15.106:0/3485293405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25600b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.553+0000 7f2565fd0640 1 --2- 172.21.15.106:0/3485293405 >> v2:172.21.15.171:3300/0 conn(0x7f2560148640 0x7f2560141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2564fce640 1 -- 172.21.15.106:0/3485293405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 msgr2=0x7f25600b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2564fce640 1 --2- 172.21.15.106:0/3485293405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25600b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2564fce640 1 -- 172.21.15.106:0/3485293405 >> v2:172.21.15.171:3300/0 conn(0x7f2560148640 msgr2=0x7f2560141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2564fce640 1 --2- 172.21.15.106:0/3485293405 >> v2:172.21.15.171:3300/0 conn(0x7f2560148640 0x7f2560141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2564fce640 1 -- 172.21.15.106:0/3485293405 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25600b53d0 con 0x7f25601481c0 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2564fce640 1 --2- 172.21.15.106:0/3485293405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25601481c0 0x7f25601418a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f25600b9b40 tx=0x7f255002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2227cd683dc8d01 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2557fff640 1 -- 172.21.15.106:0/3485293405 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255002e070 con 0x7f25601481c0 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2557fff640 1 -- 172.21.15.106:0/3485293405 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2550037070 con 0x7f25601481c0 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.554+0000 7f2557fff640 1 -- 172.21.15.106:0/3485293405 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550031a00 con 0x7f25601481c0 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 -- 172.21.15.106:0/3485293405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25601481c0 msgr2=0x7f25601418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 --2- 172.21.15.106:0/3485293405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25601481c0 0x7f25601418a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f25600b9b40 tx=0x7f255002b880 comp rx=0 tx=0).stop 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 -- 172.21.15.106:0/3485293405 shutdown_connections 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 --2- 172.21.15.106:0/3485293405 >> v2:172.21.15.171:3300/0 conn(0x7f2560148640 0x7f2560141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 --2- 172.21.15.106:0/3485293405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25601481c0 0x7f25601418a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 --2- 172.21.15.106:0/3485293405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25600b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 -- 172.21.15.106:0/3485293405 >> 172.21.15.106:0/3485293405 conn(0x7f2560068080 msgr2=0x7f25600bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 -- 172.21.15.106:0/3485293405 shutdown_connections 2024-04-16T12:57:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.555+0000 7f2567a33640 1 -- 172.21.15.106:0/3485293405 wait complete. 2024-04-16T12:57:51.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.556+0000 7f2567a33640 1 Processor -- start 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.556+0000 7f2567a33640 1 -- start start 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2567a33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25601e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2567a33640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25601481c0 0x7f25601cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2567a33640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2560148640 0x7f25601d1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2567a33640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f25600b5b30 con 0x7f2560148640 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2567a33640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f25600b59b0 con 0x7f25601481c0 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2567a33640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f25600b5cb0 con 0x7f25600b63a0 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2565fd0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2560148640 0x7f25601d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2564fce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25601481c0 0x7f25601cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f25657cf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25601e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f25657cf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25601e0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:57954/0 (socket says 172.21.15.106:57954) 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f25657cf640 1 -- 172.21.15.106:0/4166144435 learned_addr learned my addr 172.21.15.106:0/4166144435 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:51.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2564fce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25601481c0 0x7f25601cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:46730/0 (socket says 172.21.15.106:46730) 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2565fd0640 1 -- 172.21.15.106:0/4166144435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 msgr2=0x7f25601e0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2565fd0640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25601e0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2565fd0640 1 -- 172.21.15.106:0/4166144435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25601481c0 msgr2=0x7f25601cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2565fd0640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25601481c0 0x7f25601cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2565fd0640 1 -- 172.21.15.106:0/4166144435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25601d0030 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2565fd0640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2560148640 0x7f25601d1430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e7c0 tx=0x7f255c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2555ffb640 1 -- 172.21.15.106:0/4166144435 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c017070 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2555ffb640 1 -- 172.21.15.106:0/4166144435 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c00c730 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2555ffb640 1 -- 172.21.15.106:0/4166144435 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c00cb60 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.557+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25601e17d0 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.558+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25601d0c30 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.559+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2560068a90 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.559+0000 7f2555ffb640 1 -- 172.21.15.106:0/4166144435 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f255c01a070 con 0x7f2560148640 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.559+0000 7f2555ffb640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f254406c920 0x7f254406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:51.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.559+0000 7f2555ffb640 1 -- 172.21.15.106:0/4166144435 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7f255c08b120 con 0x7f2560148640 2024-04-16T12:57:51.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.559+0000 7f25657cf640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f254406c920 0x7f254406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:51.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.560+0000 7f25657cf640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f254406c920 0x7f254406ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2558009a40 tx=0x7f255800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.564+0000 7f2555ffb640 1 -- 172.21.15.106:0/4166144435 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25601d0030 con 0x7f2560148640 2024-04-16T12:57:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:51.750+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f25601466b0 con 0x7f2560148640 2024-04-16T12:57:52.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.387+0000 7f2555ffb640 1 -- 172.21.15.106:0/4166144435 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7f255c059200 con 0x7f2560148640 2024-04-16T12:57:52.389 INFO:teuthology.orchestra.run.smithi106.stderr: removed all blocklist entries 2024-04-16T12:57:52.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f254406c920 msgr2=0x7f254406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f254406c920 0x7f254406ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2558009a40 tx=0x7f255800b040 comp rx=0 tx=0).stop 2024-04-16T12:57:52.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2560148640 msgr2=0x7f25601d1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2560148640 0x7f25601d1430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e7c0 tx=0x7f255c00ec80 comp rx=0 tx=0).stop 2024-04-16T12:57:52.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 shutdown_connections 2024-04-16T12:57:52.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f254406c920 0x7f254406ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2560148640 0x7f25601d1430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25601481c0 0x7f25601cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 --2- 172.21.15.106:0/4166144435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25600b63a0 0x7f25601e0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 >> 172.21.15.106:0/4166144435 conn(0x7f2560068080 msgr2=0x7f2560147810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:52.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 shutdown_connections 2024-04-16T12:57:52.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.390+0000 7f2567a33640 1 -- 172.21.15.106:0/4166144435 wait complete. 2024-04-16T12:57:52.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T12:57:52.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.512+0000 7fd882a14640 1 Processor -- start 2024-04-16T12:57:52.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.512+0000 7fd882a14640 1 -- start start 2024-04-16T12:57:52.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd882a14640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd87c0b63a0 0x7fd87c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd882a14640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd87c148670 0x7fd87c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd882a14640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87c148b70 con 0x7fd87c1481c0 2024-04-16T12:57:52.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd882a14640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd87c0b4bd0 con 0x7fd87c148670 2024-04-16T12:57:52.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd882a14640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd87c0b4eb0 con 0x7fd87c0b63a0 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd880fb1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd87c148670 0x7fd87c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd873fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd87c1481c0 0x7fd87c1418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50870/0 (socket says 172.21.15.106:50870) 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd873fff640 1 -- 172.21.15.106:0/3652260477 learned_addr learned my addr 172.21.15.106:0/3652260477 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd880fb1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd87c148670 0x7fd87c0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33958/0 (socket says 172.21.15.106:33958) 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd87bfff640 1 --2- 172.21.15.106:0/3652260477 >> v2:172.21.15.171:3300/0 conn(0x7fd87c0b63a0 0x7fd87c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd880fb1640 1 -- 172.21.15.106:0/3652260477 >> v2:172.21.15.171:3300/0 conn(0x7fd87c0b63a0 msgr2=0x7fd87c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd880fb1640 1 --2- 172.21.15.106:0/3652260477 >> v2:172.21.15.171:3300/0 conn(0x7fd87c0b63a0 0x7fd87c0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd880fb1640 1 -- 172.21.15.106:0/3652260477 >> v1:172.21.15.106:6789/0 conn(0x7fd87c1481c0 legacy=0x7fd87c1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd880fb1640 1 -- 172.21.15.106:0/3652260477 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c141fb0 con 0x7fd87c148670 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd87b7fe640 1 -- 172.21.15.106:0/3652260477 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706318059 0 0) 0x7fd87c148b70 con 0x7fd87c1481c0 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.513+0000 7fd87bfff640 1 --2- 172.21.15.106:0/3652260477 >> v2:172.21.15.171:3300/0 conn(0x7fd87c0b63a0 0x7fd87c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.514+0000 7fd880fb1640 1 --2- 172.21.15.106:0/3652260477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c148670 0x7fd87c0b53d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0b9e70 tx=0x7fd87402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569e359aff2b2f40 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:52.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.514+0000 7fd87b7fe640 1 -- 172.21.15.106:0/3652260477 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874039070 con 0x7fd87c148670 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.514+0000 7fd87b7fe640 1 -- 172.21.15.106:0/3652260477 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87402cbf0 con 0x7fd87c148670 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.514+0000 7fd87b7fe640 1 -- 172.21.15.106:0/3652260477 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874034440 con 0x7fd87c148670 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 -- 172.21.15.106:0/3652260477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c148670 msgr2=0x7fd87c0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 --2- 172.21.15.106:0/3652260477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c148670 0x7fd87c0b53d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0b9e70 tx=0x7fd87402be40 comp rx=0 tx=0).stop 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 -- 172.21.15.106:0/3652260477 shutdown_connections 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 --2- 172.21.15.106:0/3652260477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c148670 0x7fd87c0b53d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 --2- 172.21.15.106:0/3652260477 >> v2:172.21.15.171:3300/0 conn(0x7fd87c0b63a0 0x7fd87c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 -- 172.21.15.106:0/3652260477 >> 172.21.15.106:0/3652260477 conn(0x7fd87c068080 msgr2=0x7fd87c0bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 -- 172.21.15.106:0/3652260477 shutdown_connections 2024-04-16T12:57:52.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.515+0000 7fd882a14640 1 -- 172.21.15.106:0/3652260477 wait complete. 2024-04-16T12:57:52.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 Processor -- start 2024-04-16T12:57:52.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 -- start start 2024-04-16T12:57:52.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87c0b63a0 0x7fd87c13bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c1481c0 0x7fd87c149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87c148670 0x7fd87c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c0b5ce0 con 0x7fd87c1481c0 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c0b5b60 con 0x7fd87c148670 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.516+0000 7fd882a14640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c152610 con 0x7fd87c0b63a0 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c1481c0 0x7fd87c149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c1481c0 0x7fd87c149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33968/0 (socket says 172.21.15.106:33968) 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 -- 172.21.15.106:0/278509106 learned_addr learned my addr 172.21.15.106:0/278509106 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd880fb1640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87c148670 0x7fd87c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd87bfff640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87c0b63a0 0x7fd87c13bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 -- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87c0b63a0 msgr2=0x7fd87c13bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87c0b63a0 0x7fd87c13bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 -- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87c148670 msgr2=0x7fd87c151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87c148670 0x7fd87c151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 -- 172.21.15.106:0/278509106 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c14a3f0 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd880fb1640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87c148670 0x7fd87c151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd873fff640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c1481c0 0x7fd87c149eb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd86400c4d0 tx=0x7fd86400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd8797fa640 1 -- 172.21.15.106:0/278509106 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864018070 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd8797fa640 1 -- 172.21.15.106:0/278509106 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd864007500 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd8797fa640 1 -- 172.21.15.106:0/278509106 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864004a20 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87c143980 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.517+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87c149990 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.519+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd87c068a90 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.519+0000 7fd8797fa640 1 -- 172.21.15.106:0/278509106 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd86401b070 con 0x7fd87c1481c0 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.520+0000 7fd8797fa640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd85c06c920 0x7fd85c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.520+0000 7fd8797fa640 1 -- 172.21.15.106:0/278509106 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fd86408aaf0 con 0x7fd87c1481c0 2024-04-16T12:57:52.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.520+0000 7fd87bfff640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd85c06c920 0x7fd85c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.520+0000 7fd87bfff640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd85c06c920 0x7fd85c06ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00a990 tx=0x7fd86c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:52.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.524+0000 7fd8797fa640 1 -- 172.21.15.106:0/278509106 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd864059270 con 0x7fd87c1481c0 2024-04-16T12:57:52.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.766+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd87c144e70 con 0x7fd87c1481c0 2024-04-16T12:57:52.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.767+0000 7fd8797fa640 1 -- 172.21.15.106:0/278509106 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+5207 (secure 0 0 0) 0x7fd864058b70 con 0x7fd87c1481c0 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_dump": [ 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.a", 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB1dR5mz1f2BxAA3f8nm/56F5V8Wt3iid+4yQ==", 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-16T12:57:52.769 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.b", 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB1dR5mURo4DRAAQ+yjbn1JKrrJlU0XBrqU1w==", 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.0", 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB4dR5mu8qAIhAAty62qQB4B6og4DOdofDK/Q==", 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.1", 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB7dR5mfQWmIBAAZboQex6qptr1wJQKCjiH8g==", 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.771 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.2", 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB+dR5mTuM2HxAASSHEOp55yJBUATitrkzHaA==", 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.3", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCBdR5mfeK3HRAApKL2bdM55Cx2BICOXPuz3w==", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.4", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCHdR5mk603KBAAm9jqGz2Ysg7izwLdhLgACQ==", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.773 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.5", 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCKdR5m1HypJhAADpt6VMjjyTSDYXe/4Hwnlw==", 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.774 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.6", 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCNdR5mGNHMJBAAfO6pcrlGRJXQBbHtuFRpHw==", 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.775 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.7", 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCQdR5mUwXIIhAAnWjEHwhGh83uTa2gaeQZtQ==", 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.0", 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB1dR5m+WbUERAAd0Ad0MV0D4YY+D2NE++aGQ==", 2024-04-16T12:57:52.776 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.admin", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB0dR5mvzryJRAAVUKDQq0gFcBWKnkWLBBpXg==", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-16T12:57:52.777 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mds", 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCVdR5myVMnOxAACnW6QqysFVhyemmK5ICQ2w==", 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mds" 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mgr", 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCVdR5mTlsnOxAAui7DM4L/XSsPF5aOa//xSg==", 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.778 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-osd", 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCVdR5mn2InOxAATvpfm9vI+iPhzA3j2XZD7g==", 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-osd" 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd", 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCVdR5mUmknOxAAX1ioP8qCnYOKZ04P7PP3CQ==", 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.779 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCVdR5mE3AnOxAAerOQuml2c0wbUwjwqxJBgQ==", 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rgw", 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCVdR5m53YnOxAA9tKmm5WiGfr3ArXU9NFoSA==", 2024-04-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.x", 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB1dR5m6YRjBBAAi87cPlg+5jqLPNNGeT62cA==", 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2024-04-16T12:57:52.781 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.y", 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB1dR5mCXdvABAAd1gF5ZJ7ffvAuMuYSOgU5w==", 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-16T12:57:52.782 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:57:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd85c06c920 msgr2=0x7fd85c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd85c06c920 0x7fd85c06ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00a990 tx=0x7fd86c008040 comp rx=0 tx=0).stop 2024-04-16T12:57:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c1481c0 msgr2=0x7fd87c149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c1481c0 0x7fd87c149eb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd86400c4d0 tx=0x7fd86400c990 comp rx=0 tx=0).stop 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 shutdown_connections 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd85c06c920 0x7fd85c06ede0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87c148670 0x7fd87c151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c1481c0 0x7fd87c149eb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 --2- 172.21.15.106:0/278509106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87c0b63a0 0x7fd87c13bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 >> 172.21.15.106:0/278509106 conn(0x7fd87c068080 msgr2=0x7fd87c146cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 shutdown_connections 2024-04-16T12:57:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.769+0000 7fd882a14640 1 -- 172.21.15.106:0/278509106 wait complete. 2024-04-16T12:57:52.786 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-16T12:57:52.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.887+0000 7f1c202a0640 1 Processor -- start 2024-04-16T12:57:52.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.887+0000 7f1c202a0640 1 -- start start 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c202a0640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c1806db00 0x7f1c180b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c202a0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c18143c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c202a0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c180b4d60 con 0x7f1c180b5520 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c202a0640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f1c180b5090 con 0x7f1c1806db00 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c202a0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1c181453c0 con 0x7f1c180b5e00 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c1e03c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c1806db00 0x7f1c180b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c1d83b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1c180b5520 0x7f1c18144cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53072/0 (socket says 172.21.15.106:53072) 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c1e03c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c1806db00 0x7f1c180b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48662/0 (socket says 172.21.15.106:48662) 2024-04-16T12:57:52.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.888+0000 7f1c1d83b640 1 -- 172.21.15.106:0/4063178904 learned_addr learned my addr 172.21.15.106:0/4063178904 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.889+0000 7f1c1e83d640 1 --2- 172.21.15.106:0/4063178904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c18143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.889+0000 7f1c1e03c640 1 -- 172.21.15.106:0/4063178904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 msgr2=0x7f1c18143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.889+0000 7f1c1e03c640 1 --2- 172.21.15.106:0/4063178904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c18143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.889+0000 7f1c1e03c640 1 -- 172.21.15.106:0/4063178904 >> v1:172.21.15.106:6789/0 conn(0x7f1c180b5520 legacy=0x7f1c18144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.889+0000 7f1c1e03c640 1 -- 172.21.15.106:0/4063178904 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1806dee0 con 0x7f1c1806db00 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.889+0000 7f1c1d03a640 1 -- 172.21.15.106:0/4063178904 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417960323 0 0) 0x7f1c180b4d60 con 0x7f1c180b5520 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.889+0000 7f1c1e03c640 1 --2- 172.21.15.106:0/4063178904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c180b3ea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c080097a0 tx=0x7f1c0802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8ebd0821ff72e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c1d03a640 1 -- 172.21.15.106:0/4063178904 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c080315a0 con 0x7f1c1806db00 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c1d03a640 1 -- 172.21.15.106:0/4063178904 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c08037070 con 0x7f1c1806db00 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c1d03a640 1 -- 172.21.15.106:0/4063178904 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08031960 con 0x7f1c1806db00 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 -- 172.21.15.106:0/4063178904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 msgr2=0x7f1c180b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 --2- 172.21.15.106:0/4063178904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c180b3ea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c080097a0 tx=0x7f1c0802b840 comp rx=0 tx=0).stop 2024-04-16T12:57:52.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 -- 172.21.15.106:0/4063178904 shutdown_connections 2024-04-16T12:57:52.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 --2- 172.21.15.106:0/4063178904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c18143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 --2- 172.21.15.106:0/4063178904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c180b3ea0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 -- 172.21.15.106:0/4063178904 >> 172.21.15.106:0/4063178904 conn(0x7f1c1809cc10 msgr2=0x7f1c1806d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:52.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 -- 172.21.15.106:0/4063178904 shutdown_connections 2024-04-16T12:57:52.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.890+0000 7f1c202a0640 1 -- 172.21.15.106:0/4063178904 wait complete. 2024-04-16T12:57:52.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.891+0000 7f1c202a0640 1 Processor -- start 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.891+0000 7f1c202a0640 1 -- start start 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c202a0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c181db1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c202a0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c1809d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c202a0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c181ce6e0 0x7f1c181d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c202a0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18144170 con 0x7f1c1806db00 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c202a0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1c180aea80 con 0x7f1c181ce6e0 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c202a0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1c181442f0 con 0x7f1c180b5e00 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c181db1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c181db1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48668/0 (socket says 172.21.15.106:48668) 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 -- 172.21.15.106:0/2822883314 learned_addr learned my addr 172.21.15.106:0/2822883314 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e83d640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c181ce6e0 0x7f1c181d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1d83b640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c1809d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 -- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 msgr2=0x7f1c1809d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c1809d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 -- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c181ce6e0 msgr2=0x7f1c181d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c181ce6e0 0x7f1c181d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 -- 172.21.15.106:0/2822883314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c181d0ed0 con 0x7f1c1806db00 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.892+0000 7f1c1e03c640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c181db1b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1c080098c0 tx=0x7f1c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.893+0000 7f1c0effd640 1 -- 172.21.15.106:0/2822883314 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08004230 con 0x7f1c1806db00 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.893+0000 7f1c0effd640 1 -- 172.21.15.106:0/2822883314 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c080043d0 con 0x7f1c1806db00 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.893+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c181cfbc0 con 0x7f1c1806db00 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.893+0000 7f1c0effd640 1 -- 172.21.15.106:0/2822883314 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08003850 con 0x7f1c1806db00 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.893+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1809df50 con 0x7f1c1806db00 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.893+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c18068a90 con 0x7f1c1806db00 2024-04-16T12:57:52.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.894+0000 7f1c0effd640 1 -- 172.21.15.106:0/2822883314 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c080039f0 con 0x7f1c1806db00 2024-04-16T12:57:52.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.894+0000 7f1c0effd640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1bfc06c920 0x7f1bfc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:52.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.895+0000 7f1c0effd640 1 -- 172.21.15.106:0/2822883314 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f1c0802f030 con 0x7f1c1806db00 2024-04-16T12:57:52.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.895+0000 7f1c1d83b640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1bfc06c920 0x7f1bfc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:52.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.895+0000 7f1c1d83b640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1bfc06c920 0x7f1bfc06ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c1806d770 tx=0x7f1c14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:52.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:52.899+0000 7f1c0effd640 1 -- 172.21.15.106:0/2822883314 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c08041070 con 0x7f1c1806db00 2024-04-16T12:57:53.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.139+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f1c181ceaf0 con 0x7f1c1806db00 2024-04-16T12:57:53.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.141+0000 7f1c0effd640 1 -- 172.21.15.106:0/2822883314 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f1c0807bed0 con 0x7f1c1806db00 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1bfc06c920 msgr2=0x7f1bfc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1bfc06c920 0x7f1bfc06ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c1806d770 tx=0x7f1c14009040 comp rx=0 tx=0).stop 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 msgr2=0x7f1c181db1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c181db1b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1c080098c0 tx=0x7f1c080046c0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 shutdown_connections 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1bfc06c920 0x7f1bfc06ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c181ce6e0 0x7f1c181d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c180b5e00 0x7f1c1809d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 --2- 172.21.15.106:0/2822883314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1806db00 0x7f1c181db1b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 >> 172.21.15.106:0/2822883314 conn(0x7f1c1809cc10 msgr2=0x7f1c180b9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 shutdown_connections 2024-04-16T12:57:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.143+0000 7f1c202a0640 1 -- 172.21.15.106:0/2822883314 wait complete. 2024-04-16T12:57:53.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-16T12:57:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.257+0000 7fef154ba640 1 Processor -- start 2024-04-16T12:57:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.257+0000 7fef154ba640 1 -- start start 2024-04-16T12:57:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef154ba640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fef1014b390 0x7fef1014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef154ba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef100be380 con 0x7fef101506b0 2024-04-16T12:57:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef154ba640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef100b4c30 con 0x7fef100bdfa0 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef154ba640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fef100b4fa0 con 0x7fef1014b390 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef0f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fef101506b0 0x7fef10152aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53086/0 (socket says 172.21.15.106:53086) 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef0f7fe640 1 -- 172.21.15.106:0/3528327661 learned_addr learned my addr 172.21.15.106:0/3528327661 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef067fc640 1 --2- 172.21.15.106:0/3528327661 >> v2:172.21.15.171:3300/0 conn(0x7fef1014b390 0x7fef1014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531291695 0 0) 0x7fef100be380 con 0x7fef101506b0 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.258+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feefc003520 con 0x7fef101506b0 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1471498062 0 0) 0x7feefc003520 con 0x7fef101506b0 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 >> v2:172.21.15.171:3300/0 conn(0x7fef1014b390 msgr2=0x7fef1014b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 --2- 172.21.15.106:0/3528327661 >> v2:172.21.15.171:3300/0 conn(0x7fef1014b390 0x7fef1014b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 >> v1:172.21.15.171:6789/0 conn(0x7fef100bdfa0 legacy=0x7fef10141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef101424d0 con 0x7fef101506b0 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fef080019f0 con 0x7fef101506b0 2024-04-16T12:57:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 >> v1:172.21.15.106:6789/0 conn(0x7fef101506b0 legacy=0x7fef10152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feefc0039b0 0x7feefc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feefc004800 0x7feefc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc0052e0 0x7feefc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b4fa0 con 0x7feefc004800 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feefc00c1b0 con 0x7feefc0039b0 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feefc00c3b0 con 0x7feefc0052e0 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef067fc640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feefc004800 0x7feefc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0effd640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feefc0039b0 0x7feefc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0f7fe640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc0052e0 0x7feefc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef067fc640 1 -- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc0052e0 msgr2=0x7feefc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef067fc640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc0052e0 0x7feefc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef067fc640 1 -- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feefc0039b0 msgr2=0x7feefc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef067fc640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feefc0039b0 0x7feefc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef067fc640 1 -- 172.21.15.106:0/3528327661 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc003520 con 0x7feefc004800 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.259+0000 7fef0f7fe640 1 -- 172.21.15.106:0/3528327661 reap_dead start 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.260+0000 7fef067fc640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feefc004800 0x7feefc004c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feef8009ac0 tx=0x7feefc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f524e7cac1c86d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.260+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8039070 con 0x7feefc004800 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.260+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef802c6b0 con 0x7feefc004800 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.260+0000 7fef0e7fc640 1 -- 172.21.15.106:0/3528327661 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8009690 con 0x7feefc004800 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.261+0000 7fef154ba640 1 -- 172.21.15.106:0/3528327661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feefc004800 msgr2=0x7feefc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.261+0000 7fef154ba640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feefc004800 0x7feefc004c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feef8009ac0 tx=0x7feefc005830 comp rx=0 tx=0).stop 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.261+0000 7fef154ba640 1 -- 172.21.15.106:0/3528327661 shutdown_connections 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.261+0000 7fef154ba640 1 --2- 172.21.15.106:0/3528327661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feefc004800 0x7feefc004c80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.261+0000 7fef154ba640 1 -- 172.21.15.106:0/3528327661 >> 172.21.15.106:0/3528327661 conn(0x7fef10067dc0 msgr2=0x7fef100bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.261+0000 7fef154ba640 1 -- 172.21.15.106:0/3528327661 shutdown_connections 2024-04-16T12:57:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.261+0000 7fef154ba640 1 -- 172.21.15.106:0/3528327661 wait complete. 2024-04-16T12:57:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 Processor -- start 2024-04-16T12:57:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 -- start start 2024-04-16T12:57:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc004800 0x7fef10139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef10145fe0 0x7fef1014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef1014a7f0 0x7fef101e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b67d0 con 0x7fef10145fe0 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b6650 con 0x7fef1014a7f0 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef154ba640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef100b54c0 con 0x7feefc004800 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.262+0000 7fef067fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef10145fe0 0x7fef1014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef10145fe0 0x7fef1014a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48688/0 (socket says 172.21.15.106:48688) 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 -- 172.21.15.106:0/3531326751 learned_addr learned my addr 172.21.15.106:0/3531326751 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef0effd640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc004800 0x7fef10139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef0f7fe640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef1014a7f0 0x7fef101e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 -- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc004800 msgr2=0x7fef10139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc004800 0x7fef10139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 -- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef1014a7f0 msgr2=0x7fef101e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef1014a7f0 0x7fef101e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 -- 172.21.15.106:0/3531326751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef10149460 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef0effd640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc004800 0x7fef10139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef0f7fe640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef1014a7f0 0x7fef101e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef067fc640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef10145fe0 0x7fef1014a2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feef8037040 tx=0x7feef8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef07fff640 1 -- 172.21.15.106:0/3531326751 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8042020 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef07fff640 1 -- 172.21.15.106:0/3531326751 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef803a040 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef07fff640 1 -- 172.21.15.106:0/3531326751 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8039070 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1014ac70 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.263+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef101467d0 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.264+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef100691a0 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.265+0000 7fef07fff640 1 -- 172.21.15.106:0/3531326751 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feef8045020 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.265+0000 7fef07fff640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7feef006c920 0x7feef006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.265+0000 7fef07fff640 1 -- 172.21.15.106:0/3531326751 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7feef80acbc0 con 0x7fef10145fe0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.265+0000 7fef0effd640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7feef006c920 0x7feef006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.266+0000 7fef0effd640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7feef006c920 0x7feef006ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef000055c0 tx=0x7fef00009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:53.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.269+0000 7fef07fff640 1 -- 172.21.15.106:0/3531326751 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feef804c070 con 0x7fef10145fe0 2024-04-16T12:57:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.516+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fef100bc4c0 con 0x7fef10145fe0 2024-04-16T12:57:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.517+0000 7fef07fff640 1 -- 172.21.15.106:0/3531326751 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fef1014ac70 con 0x7fef10145fe0 2024-04-16T12:57:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.519+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7feef006c920 msgr2=0x7feef006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.519+0000 7fef154ba640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7feef006c920 0x7feef006ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef000055c0 tx=0x7fef00009040 comp rx=0 tx=0).stop 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.519+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef10145fe0 msgr2=0x7fef1014a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.519+0000 7fef154ba640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef10145fe0 0x7fef1014a2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feef8037040 tx=0x7feef8004730 comp rx=0 tx=0).stop 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 shutdown_connections 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7feef006c920 0x7feef006ede0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef1014a7f0 0x7fef101e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef10145fe0 0x7fef1014a2b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 --2- 172.21.15.106:0/3531326751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feefc004800 0x7fef10139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 >> 172.21.15.106:0/3531326751 conn(0x7fef10067dc0 msgr2=0x7fef1013ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 shutdown_connections 2024-04-16T12:57:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.520+0000 7fef154ba640 1 -- 172.21.15.106:0/3531326751 wait complete. 2024-04-16T12:57:53.532 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-16T12:57:53.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.635+0000 7ff499fe9640 1 Processor -- start 2024-04-16T12:57:53.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.635+0000 7ff499fe9640 1 -- start start 2024-04-16T12:57:53.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.635+0000 7ff499fe9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff4940b53d0 0x7ff4940b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.635+0000 7ff499fe9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4941488d0 con 0x7ff4940b6780 2024-04-16T12:57:53.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.635+0000 7ff499fe9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4940b5d40 con 0x7ff4940b63a0 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.635+0000 7ff499fe9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff494148b70 con 0x7ff4940b53d0 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff48bfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff4940b6780 0x7ff4941418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53096/0 (socket says 172.21.15.106:53096) 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff48bfff640 1 -- 172.21.15.106:0/2406620087 learned_addr learned my addr 172.21.15.106:0/2406620087 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1088154833 0 0) 0x7ff4941488d0 con 0x7ff4940b6780 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff480003520 con 0x7ff4940b6780 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff493fff640 1 --2- 172.21.15.106:0/2406620087 >> v2:172.21.15.171:3300/0 conn(0x7ff4940b53d0 0x7ff4940b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2982405923 0 0) 0x7ff480003520 con 0x7ff4940b6780 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 >> v2:172.21.15.171:3300/0 conn(0x7ff4940b53d0 msgr2=0x7ff4940b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 --2- 172.21.15.106:0/2406620087 >> v2:172.21.15.171:3300/0 conn(0x7ff4940b53d0 0x7ff4940b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 >> v1:172.21.15.171:6789/0 conn(0x7ff4940b63a0 legacy=0x7ff4941481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4940b4bd0 con 0x7ff4940b6780 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7ff47c001690 con 0x7ff4940b6780 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff493fff640 1 --2- 172.21.15.106:0/2406620087 >> v2:172.21.15.171:3300/0 conn(0x7ff4940b53d0 0x7ff4940b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 >> v1:172.21.15.106:6789/0 conn(0x7ff4940b6780 legacy=0x7ff4941418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480003a00 0x7ff480003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff480004800 0x7ff480004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4800052e0 0x7ff48000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff494148b70 con 0x7ff480004800 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff48000c200 con 0x7ff4800052e0 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff48000c400 con 0x7ff480003a00 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff48bfff640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff480004800 0x7ff480004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff4937fe640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480003a00 0x7ff480003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.636+0000 7ff493fff640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4800052e0 0x7ff48000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff48bfff640 1 -- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480003a00 msgr2=0x7ff480003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff48bfff640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480003a00 0x7ff480003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff48bfff640 1 -- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4800052e0 msgr2=0x7ff48000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff48bfff640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4800052e0 0x7ff48000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff493fff640 1 -- 172.21.15.106:0/2406620087 reap_dead start 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff48bfff640 1 -- 172.21.15.106:0/2406620087 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff480003520 con 0x7ff480004800 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff48bfff640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff480004800 0x7ff480004c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00c160 tx=0x7ff480005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188cf407399ebb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c007c80 con 0x7ff480004800 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47c030070 con 0x7ff480004800 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.637+0000 7ff492ffd640 1 -- 172.21.15.106:0/2406620087 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c005d30 con 0x7ff480004800 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.638+0000 7ff499fe9640 1 -- 172.21.15.106:0/2406620087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff480004800 msgr2=0x7ff480004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.638+0000 7ff499fe9640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff480004800 0x7ff480004c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00c160 tx=0x7ff480005830 comp rx=0 tx=0).stop 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.638+0000 7ff499fe9640 1 -- 172.21.15.106:0/2406620087 shutdown_connections 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.638+0000 7ff499fe9640 1 --2- 172.21.15.106:0/2406620087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff480004800 0x7ff480004c80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.638+0000 7ff499fe9640 1 -- 172.21.15.106:0/2406620087 >> 172.21.15.106:0/2406620087 conn(0x7ff494068080 msgr2=0x7ff4940bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.638+0000 7ff499fe9640 1 -- 172.21.15.106:0/2406620087 shutdown_connections 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.638+0000 7ff499fe9640 1 -- 172.21.15.106:0/2406620087 wait complete. 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.639+0000 7ff499fe9640 1 Processor -- start 2024-04-16T12:57:53.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.639+0000 7ff499fe9640 1 -- start start 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff499fe9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480004800 0x7ff49414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff499fe9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4941dd6e0 0x7ff4941ddb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff499fe9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4941e0900 0x7ff4941e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff499fe9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940b5980 con 0x7ff4941e0900 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff499fe9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940b5800 con 0x7ff4941dd6e0 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff499fe9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4940b5b00 con 0x7ff480004800 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4941e0900 0x7ff4941e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4941e0900 0x7ff4941e0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48714/0 (socket says 172.21.15.106:48714) 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 -- 172.21.15.106:0/3661549739 learned_addr learned my addr 172.21.15.106:0/3661549739 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff4937fe640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480004800 0x7ff49414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff48bfff640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4941dd6e0 0x7ff4941ddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 -- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480004800 msgr2=0x7ff49414ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480004800 0x7ff49414ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 -- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4941dd6e0 msgr2=0x7ff4941ddb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4941dd6e0 0x7ff4941ddb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 -- 172.21.15.106:0/3661549739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4941de0a0 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff493fff640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4941e0900 0x7ff4941e0d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4940b9e40 tx=0x7ff48c010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff490ff9640 1 -- 172.21.15.106:0/3661549739 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c010cf0 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff490ff9640 1 -- 172.21.15.106:0/3661549739 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c003990 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff494148180 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.640+0000 7ff490ff9640 1 -- 172.21.15.106:0/3661549739 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c003b80 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.641+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4941d3a70 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.641+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff494068a90 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.642+0000 7ff490ff9640 1 -- 172.21.15.106:0/3661549739 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff48c01e030 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.642+0000 7ff490ff9640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff47406c8f0 0x7ff47406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.642+0000 7ff490ff9640 1 -- 172.21.15.106:0/3661549739 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7ff48c08bd90 con 0x7ff4941e0900 2024-04-16T12:57:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.643+0000 7ff4937fe640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff47406c8f0 0x7ff47406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.643+0000 7ff4937fe640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff47406c8f0 0x7ff47406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff484000c00 tx=0x7ff484009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.647+0000 7ff490ff9640 1 -- 172.21.15.106:0/3661549739 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff48c025020 con 0x7ff4941e0900 2024-04-16T12:57:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.887+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7ff4940a9c90 con 0x7ff4941e0900 2024-04-16T12:57:53.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.889+0000 7ff490ff9640 1 -- 172.21.15.106:0/3661549739 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7ff4941de0a0 con 0x7ff4941e0900 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff47406c8f0 msgr2=0x7ff47406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff47406c8f0 0x7ff47406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff484000c00 tx=0x7ff484009040 comp rx=0 tx=0).stop 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4941e0900 msgr2=0x7ff4941e0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4941e0900 0x7ff4941e0d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4940b9e40 tx=0x7ff48c010530 comp rx=0 tx=0).stop 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 shutdown_connections 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff47406c8f0 0x7ff47406edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4941e0900 0x7ff4941e0d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4941dd6e0 0x7ff4941ddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 --2- 172.21.15.106:0/3661549739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff480004800 0x7ff49414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 >> 172.21.15.106:0/3661549739 conn(0x7ff494068080 msgr2=0x7ff4940bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 shutdown_connections 2024-04-16T12:57:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:53.891+0000 7ff499fe9640 1 -- 172.21.15.106:0/3661549739 wait complete. 2024-04-16T12:57:53.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-16T12:57:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.006+0000 7f1d62f00640 1 Processor -- start 2024-04-16T12:57:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.006+0000 7f1d62f00640 1 -- start start 2024-04-16T12:57:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.006+0000 7f1d62f00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c148680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.006+0000 7f1d62f00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1d5c148bc0 0x7f1d5c152800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.006+0000 7f1d62f00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5c06db60 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.006+0000 7f1d62f00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5c0b7df0 con 0x7f1d5c148bc0 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.006+0000 7f1d62f00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c06cc60 con 0x7f1d5c0b51b0 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d6149d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1d5c148bc0 0x7f1d5c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d60c9c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1d5c0bbe20 0x7f1d5c06e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:57950/0 (socket says 172.21.15.106:57950) 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d60c9c640 1 -- 172.21.15.106:0/687599840 learned_addr learned my addr 172.21.15.106:0/687599840 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d6149d640 1 --2- 172.21.15.106:0/687599840 >> v2:172.21.15.171:3300/0 conn(0x7f1d5c148bc0 0x7f1d5c152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:59922/0 (socket says 172.21.15.106:59922) 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d6149d640 1 -- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 msgr2=0x7f1d5c148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d6149d640 1 --2- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d6149d640 1 -- 172.21.15.106:0/687599840 >> v1:172.21.15.171:6789/0 conn(0x7f1d5c0bbe20 legacy=0x7f1d5c06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d6149d640 1 -- 172.21.15.106:0/687599840 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c0bc200 con 0x7f1d5c148bc0 2024-04-16T12:57:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.007+0000 7f1d5bfff640 1 --2- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d6149d640 1 --2- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 0x7f1d5c152800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009d90 tx=0x7f1d5402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e564919c4598a887 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d5b7fe640 1 -- 172.21.15.106:0/687599840 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54039070 con 0x7f1d5c148bc0 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d5b7fe640 1 -- 172.21.15.106:0/687599840 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d5402cb30 con 0x7f1d5c148bc0 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d5b7fe640 1 -- 172.21.15.106:0/687599840 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54034440 con 0x7f1d5c148bc0 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d62f00640 1 -- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 msgr2=0x7f1d5c152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d62f00640 1 --2- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 0x7f1d5c152800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009d90 tx=0x7f1d5402bd80 comp rx=0 tx=0).stop 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d62f00640 1 -- 172.21.15.106:0/687599840 shutdown_connections 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d62f00640 1 --2- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 0x7f1d5c152800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d62f00640 1 --2- 172.21.15.106:0/687599840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.008+0000 7f1d62f00640 1 -- 172.21.15.106:0/687599840 >> 172.21.15.106:0/687599840 conn(0x7f1d5c067e20 msgr2=0x7f1d5c0bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.009+0000 7f1d62f00640 1 -- 172.21.15.106:0/687599840 shutdown_connections 2024-04-16T12:57:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.009+0000 7f1d62f00640 1 -- 172.21.15.106:0/687599840 wait complete. 2024-04-16T12:57:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 Processor -- start 2024-04-16T12:57:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 -- start start 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c1ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d5c0bbe20 0x7f1d5c1dd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 0x7f1d5c1d33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c0b62b0 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c06de40 con 0x7f1d5c148bc0 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d62f00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c0b2570 con 0x7f1d5c0b51b0 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.010+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d5c0bbe20 0x7f1d5c1dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d5c0bbe20 0x7f1d5c1dd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48726/0 (socket says 172.21.15.106:48726) 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 -- 172.21.15.106:0/4056270138 learned_addr learned my addr 172.21.15.106:0/4056270138 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d60c9c640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c1ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d6149d640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 0x7f1d5c1d33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 -- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 msgr2=0x7f1d5c1ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c1ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 -- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 msgr2=0x7f1d5c1d33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 0x7f1d5c1d33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 -- 172.21.15.106:0/4056270138 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c1ce130 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d5bfff640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d5c0bbe20 0x7f1d5c1dd380 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800e9b0 tx=0x7f1d4800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d597fa640 1 -- 172.21.15.106:0/4056270138 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48017070 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d597fa640 1 -- 172.21.15.106:0/4056270138 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4800ca00 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5c1cfbb0 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d597fa640 1 -- 172.21.15.106:0/4056270138 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800cdf0 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.011+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5c0aff30 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.012+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5c0691a0 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.013+0000 7f1d597fa640 1 -- 172.21.15.106:0/4056270138 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d4801a070 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.013+0000 7f1d597fa640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d4006c8f0 0x7f1d4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.013+0000 7f1d597fa640 1 -- 172.21.15.106:0/4056270138 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f1d4808b2b0 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.013+0000 7f1d60c9c640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d4006c8f0 0x7f1d4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.013+0000 7f1d60c9c640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d4006c8f0 0x7f1d4006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0afa60 tx=0x7f1d50007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.017+0000 7f1d597fa640 1 -- 172.21.15.106:0/4056270138 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d48059470 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.261+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f1d5c0b47c0 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.263+0000 7f1d597fa640 1 -- 172.21.15.106:0/4056270138 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f1d4805d770 con 0x7f1d5c0bbe20 2024-04-16T12:57:54.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.265+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d4006c8f0 msgr2=0x7f1d4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.265+0000 7f1d62f00640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d4006c8f0 0x7f1d4006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0afa60 tx=0x7f1d50007e80 comp rx=0 tx=0).stop 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.265+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d5c0bbe20 msgr2=0x7f1d5c1dd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.265+0000 7f1d62f00640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d5c0bbe20 0x7f1d5c1dd380 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800e9b0 tx=0x7f1d4800ee70 comp rx=0 tx=0).stop 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 shutdown_connections 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f1d4006c8f0 0x7f1d4006edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d5c148bc0 0x7f1d5c1d33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d5c0bbe20 0x7f1d5c1dd380 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 --2- 172.21.15.106:0/4056270138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d5c0b51b0 0x7f1d5c1ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 >> 172.21.15.106:0/4056270138 conn(0x7f1d5c067e20 msgr2=0x7f1d5c0b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 shutdown_connections 2024-04-16T12:57:54.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.266+0000 7f1d62f00640 1 -- 172.21.15.106:0/4056270138 wait complete. 2024-04-16T12:57:54.278 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-16T12:57:54.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.380+0000 7fe6c7aa5640 1 Processor -- start 2024-04-16T12:57:54.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c7aa5640 1 -- start start 2024-04-16T12:57:54.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c7aa5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe6c00679d0 0x7fe6c00b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c7aa5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00b0ac0 0x7fe6c00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c7aa5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6c009fb60 0x7fe6c0144d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c7aa5640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c00b45f0 con 0x7fe6c009fb60 2024-04-16T12:57:54.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c7aa5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c00b01c0 con 0x7fe6c00679d0 2024-04-16T12:57:54.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c7aa5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c0067db0 con 0x7fe6c00b0ac0 2024-04-16T12:57:54.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c6042640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6c009fb60 0x7fe6c0144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c6042640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6c009fb60 0x7fe6c0144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48740/0 (socket says 172.21.15.106:48740) 2024-04-16T12:57:54.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.381+0000 7fe6c6042640 1 -- 172.21.15.106:0/1874325858 learned_addr learned my addr 172.21.15.106:0/1874325858 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c5040640 1 --2- 172.21.15.106:0/1874325858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00b0ac0 0x7fe6c00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c5841640 1 --2- 172.21.15.106:0/1874325858 >> v2:172.21.15.171:3300/0 conn(0x7fe6c00679d0 0x7fe6c00b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c6042640 1 -- 172.21.15.106:0/1874325858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00b0ac0 msgr2=0x7fe6c00afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c6042640 1 --2- 172.21.15.106:0/1874325858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00b0ac0 0x7fe6c00afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c6042640 1 -- 172.21.15.106:0/1874325858 >> v2:172.21.15.171:3300/0 conn(0x7fe6c00679d0 msgr2=0x7fe6c00b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c6042640 1 --2- 172.21.15.106:0/1874325858 >> v2:172.21.15.171:3300/0 conn(0x7fe6c00679d0 0x7fe6c00b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c6042640 1 -- 172.21.15.106:0/1874325858 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c00b5b10 con 0x7fe6c009fb60 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c6042640 1 --2- 172.21.15.106:0/1874325858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c0144d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe6c006ca60 tx=0x7fe6b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfe0115f1fced80 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.382+0000 7fe6c483f640 1 -- 172.21.15.106:0/1874325858 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b802ca70 con 0x7fe6c009fb60 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c483f640 1 -- 172.21.15.106:0/1874325858 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b802cc10 con 0x7fe6c009fb60 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c483f640 1 -- 172.21.15.106:0/1874325858 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80343f0 con 0x7fe6c009fb60 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/1874325858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 msgr2=0x7fe6c0144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/1874325858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c0144d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe6c006ca60 tx=0x7fe6b802bed0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/1874325858 shutdown_connections 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/1874325858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c0144d40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/1874325858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00b0ac0 0x7fe6c00afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/1874325858 >> v2:172.21.15.171:3300/0 conn(0x7fe6c00679d0 0x7fe6c00b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/1874325858 >> 172.21.15.106:0/1874325858 conn(0x7fe6c00b9ca0 msgr2=0x7fe6c00ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/1874325858 shutdown_connections 2024-04-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.383+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/1874325858 wait complete. 2024-04-16T12:57:54.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.384+0000 7fe6c7aa5640 1 Processor -- start 2024-04-16T12:57:54.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.384+0000 7fe6c7aa5640 1 -- start start 2024-04-16T12:57:54.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c7aa5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00679d0 0x7fe6c00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c7aa5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c01dd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c7aa5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6c00b0ac0 0x7fe6c013fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c7aa5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c0145280 con 0x7fe6c009fb60 2024-04-16T12:57:54.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c7aa5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c00b57d0 con 0x7fe6c00b0ac0 2024-04-16T12:57:54.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c7aa5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c0145400 con 0x7fe6c00679d0 2024-04-16T12:57:54.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c01dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c01dd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48748/0 (socket says 172.21.15.106:48748) 2024-04-16T12:57:54.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 -- 172.21.15.106:0/3217987646 learned_addr learned my addr 172.21.15.106:0/3217987646 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:54.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 -- 172.21.15.106:0/3217987646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00679d0 msgr2=0x7fe6c00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00679d0 0x7fe6c00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 -- 172.21.15.106:0/3217987646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6c00b0ac0 msgr2=0x7fe6c013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6c00b0ac0 0x7fe6c013fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 -- 172.21.15.106:0/3217987646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c00b3f10 con 0x7fe6c009fb60 2024-04-16T12:57:54.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6c5040640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c01dd480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c820 tx=0x7fe6b000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.385+0000 7fe6b67fc640 1 -- 172.21.15.106:0/3217987646 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0015070 con 0x7fe6c009fb60 2024-04-16T12:57:54.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.386+0000 7fe6b67fc640 1 -- 172.21.15.106:0/3217987646 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0004020 con 0x7fe6c009fb60 2024-04-16T12:57:54.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.386+0000 7fe6b67fc640 1 -- 172.21.15.106:0/3217987646 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00043f0 con 0x7fe6c009fb60 2024-04-16T12:57:54.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.386+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c01cece0 con 0x7fe6c009fb60 2024-04-16T12:57:54.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.386+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c0148760 con 0x7fe6c009fb60 2024-04-16T12:57:54.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.386+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c0068a90 con 0x7fe6c009fb60 2024-04-16T12:57:54.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.387+0000 7fe6b67fc640 1 -- 172.21.15.106:0/3217987646 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6b0007830 con 0x7fe6c009fb60 2024-04-16T12:57:54.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.387+0000 7fe6b67fc640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe6a406c920 0x7fe6a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.388+0000 7fe6b67fc640 1 -- 172.21.15.106:0/3217987646 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fe6b008b440 con 0x7fe6c009fb60 2024-04-16T12:57:54.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.388+0000 7fe6c5841640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe6a406c920 0x7fe6a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.388+0000 7fe6c5841640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe6a406c920 0x7fe6a406ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc006fd0 tx=0x7fe6bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.394+0000 7fe6b67fc640 1 -- 172.21.15.106:0/3217987646 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6b0059c50 con 0x7fe6c009fb60 2024-04-16T12:57:54.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.635+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fe6c00b0690 con 0x7fe6c009fb60 2024-04-16T12:57:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.637+0000 7fe6b67fc640 1 -- 172.21.15.106:0/3217987646 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7fe6b0059550 con 0x7fe6c009fb60 2024-04-16T12:57:54.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe6a406c920 msgr2=0x7fe6a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe6a406c920 0x7fe6a406ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc006fd0 tx=0x7fe6bc008040 comp rx=0 tx=0).stop 2024-04-16T12:57:54.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 msgr2=0x7fe6c01dd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c01dd480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c820 tx=0x7fe6b000cce0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 shutdown_connections 2024-04-16T12:57:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe6a406c920 0x7fe6a406ede0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6c00b0ac0 0x7fe6c013fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c009fb60 0x7fe6c01dd480 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 --2- 172.21.15.106:0/3217987646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6c00679d0 0x7fe6c00b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 >> 172.21.15.106:0/3217987646 conn(0x7fe6c00b9ca0 msgr2=0x7fe6c0070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 shutdown_connections 2024-04-16T12:57:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.639+0000 7fe6c7aa5640 1 -- 172.21.15.106:0/3217987646 wait complete. 2024-04-16T12:57:54.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-16T12:57:54.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f6841837640 1 Processor -- start 2024-04-16T12:57:54.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f6841837640 1 -- start start 2024-04-16T12:57:54.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f6841837640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f683c0b63a0 0x7f683c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f6841837640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683c148b70 con 0x7f683c148670 2024-04-16T12:57:54.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f6841837640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683c0b4bd0 con 0x7f683c1481c0 2024-04-16T12:57:54.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f6841837640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f683c0b4eb0 con 0x7f683c0b63a0 2024-04-16T12:57:54.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f683b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f683c148670 0x7f683c0b53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53112/0 (socket says 172.21.15.106:53112) 2024-04-16T12:57:54.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f683b7fe640 1 -- 172.21.15.106:0/1890032565 learned_addr learned my addr 172.21.15.106:0/1890032565 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:54.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.754+0000 7f683affd640 1 --2- 172.21.15.106:0/1890032565 >> v2:172.21.15.171:3300/0 conn(0x7f683c0b63a0 0x7f683c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.755+0000 7f6839ffb640 1 -- 172.21.15.106:0/1890032565 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310542315 0 0) 0x7f683c148b70 con 0x7f683c148670 2024-04-16T12:57:54.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.755+0000 7f6839ffb640 1 -- 172.21.15.106:0/1890032565 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6824003520 con 0x7f683c148670 2024-04-16T12:57:54.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.755+0000 7f683affd640 1 -- 172.21.15.106:0/1890032565 >> v1:172.21.15.171:6789/0 conn(0x7f683c1481c0 legacy=0x7f683c1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.755+0000 7f683affd640 1 -- 172.21.15.106:0/1890032565 >> v1:172.21.15.106:6789/0 conn(0x7f683c148670 legacy=0x7f683c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.755+0000 7f683affd640 1 -- 172.21.15.106:0/1890032565 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c141fb0 con 0x7f683c0b63a0 2024-04-16T12:57:54.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f683affd640 1 --2- 172.21.15.106:0/1890032565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 0x7f683c0b6780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f682c0097a0 tx=0x7f682c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e03a08c303460981 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6839ffb640 1 -- 172.21.15.106:0/1890032565 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c035020 con 0x7f683c0b63a0 2024-04-16T12:57:54.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6839ffb640 1 -- 172.21.15.106:0/1890032565 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c031830 con 0x7f683c0b63a0 2024-04-16T12:57:54.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6839ffb640 1 -- 172.21.15.106:0/1890032565 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c031be0 con 0x7f683c0b63a0 2024-04-16T12:57:54.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6841837640 1 -- 172.21.15.106:0/1890032565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 msgr2=0x7f683c0b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6841837640 1 --2- 172.21.15.106:0/1890032565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 0x7f683c0b6780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f682c0097a0 tx=0x7f682c02b8d0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6841837640 1 -- 172.21.15.106:0/1890032565 shutdown_connections 2024-04-16T12:57:54.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6841837640 1 --2- 172.21.15.106:0/1890032565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 0x7f683c0b6780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.756+0000 7f6841837640 1 -- 172.21.15.106:0/1890032565 >> 172.21.15.106:0/1890032565 conn(0x7f683c068080 msgr2=0x7f683c0bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:54.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.757+0000 7f6841837640 1 -- 172.21.15.106:0/1890032565 shutdown_connections 2024-04-16T12:57:54.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.757+0000 7f6841837640 1 -- 172.21.15.106:0/1890032565 wait complete. 2024-04-16T12:57:54.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.757+0000 7f6841837640 1 Processor -- start 2024-04-16T12:57:54.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f6841837640 1 -- start start 2024-04-16T12:57:54.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f6841837640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 0x7f683c1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f6841837640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c1481c0 0x7f683c144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f6841837640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f683c148670 0x7f683c13a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f6841837640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f683c153620 con 0x7f683c148670 2024-04-16T12:57:54.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f6841837640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f683c0b5d70 con 0x7f683c0b63a0 2024-04-16T12:57:54.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f6841837640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f683c1537a0 con 0x7f683c1481c0 2024-04-16T12:57:54.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f683b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f683c148670 0x7f683c13a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f683b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f683c148670 0x7f683c13a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48758/0 (socket says 172.21.15.106:48758) 2024-04-16T12:57:54.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f683b7fe640 1 -- 172.21.15.106:0/3703806797 learned_addr learned my addr 172.21.15.106:0/3703806797 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f683a7fc640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c1481c0 0x7f683c144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.758+0000 7f683affd640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 0x7f683c1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f683b7fe640 1 -- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c1481c0 msgr2=0x7f683c144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f683b7fe640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c1481c0 0x7f683c144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f683b7fe640 1 -- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 msgr2=0x7f683c1451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f683b7fe640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 0x7f683c1451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:54.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f683b7fe640 1 -- 172.21.15.106:0/3703806797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c13bcd0 con 0x7f683c148670 2024-04-16T12:57:54.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f683b7fe640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f683c148670 0x7f683c13a160 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f683400caa0 tx=0x7f683400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f6823fff640 1 -- 172.21.15.106:0/3703806797 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834017070 con 0x7f683c148670 2024-04-16T12:57:54.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f6823fff640 1 -- 172.21.15.106:0/3703806797 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f683400aba0 con 0x7f683c148670 2024-04-16T12:57:54.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f6823fff640 1 -- 172.21.15.106:0/3703806797 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834012400 con 0x7f683c148670 2024-04-16T12:57:54.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c1ddd80 con 0x7f683c148670 2024-04-16T12:57:54.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.759+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c13b9f0 con 0x7f683c148670 2024-04-16T12:57:54.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.760+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683c1ddbb0 con 0x7f683c148670 2024-04-16T12:57:54.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.761+0000 7f6823fff640 1 -- 172.21.15.106:0/3703806797 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f683401a070 con 0x7f683c148670 2024-04-16T12:57:54.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.761+0000 7f6823fff640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f682806c8f0 0x7f682806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:54.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.761+0000 7f683affd640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f682806c8f0 0x7f682806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:54.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.761+0000 7f6823fff640 1 -- 172.21.15.106:0/3703806797 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f683408b400 con 0x7f683c148670 2024-04-16T12:57:54.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.761+0000 7f683affd640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f682806c8f0 0x7f682806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f682c036000 tx=0x7f682c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:54.765+0000 7f6823fff640 1 -- 172.21.15.106:0/3703806797 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f68340595c0 con 0x7f683c148670 2024-04-16T12:57:55.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.007+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f683c068a90 con 0x7f683c148670 2024-04-16T12:57:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.008+0000 7f6823fff640 1 -- 172.21.15.106:0/3703806797 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f683405d8c0 con 0x7f683c148670 2024-04-16T12:57:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.010+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f682806c8f0 msgr2=0x7f682806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.010+0000 7f6841837640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f682806c8f0 0x7f682806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f682c036000 tx=0x7f682c03d040 comp rx=0 tx=0).stop 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.010+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f683c148670 msgr2=0x7f683c13a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.010+0000 7f6841837640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f683c148670 0x7f683c13a160 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f683400caa0 tx=0x7f683400cf60 comp rx=0 tx=0).stop 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.010+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 shutdown_connections 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.010+0000 7f6841837640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f682806c8f0 0x7f682806edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.010+0000 7f6841837640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f683c148670 0x7f683c13a160 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.011+0000 7f6841837640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c1481c0 0x7f683c144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.011+0000 7f6841837640 1 --2- 172.21.15.106:0/3703806797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0b63a0 0x7f683c1451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.011+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 >> 172.21.15.106:0/3703806797 conn(0x7f683c068080 msgr2=0x7f683c0bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.011+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 shutdown_connections 2024-04-16T12:57:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.011+0000 7f6841837640 1 -- 172.21.15.106:0/3703806797 wait complete. 2024-04-16T12:57:55.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:55.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.124+0000 7f35438c8640 1 Processor -- start 2024-04-16T12:57:55.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.124+0000 7f35438c8640 1 -- start start 2024-04-16T12:57:55.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f35438c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 0x7f353c06f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f35438c8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c06fb40 con 0x7f353c06f6b0 2024-04-16T12:57:55.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f35438c8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c06c7d0 con 0x7f353c0b82b0 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f35438c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f353c0b9630 con 0x7f353c0b9d30 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3541e65640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f353c06f6b0 0x7f353c06c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53120/0 (socket says 172.21.15.106:53120) 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3541e65640 1 -- 172.21.15.106:0/2912660590 learned_addr learned my addr 172.21.15.106:0/2912660590 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3541664640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 0x7f353c06f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3151708029 0 0) 0x7f353c06fb40 con 0x7f353c06f6b0 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3528003520 con 0x7f353c06f6b0 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4001516714 0 0) 0x7f3528003520 con 0x7f353c06f6b0 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 msgr2=0x7f353c06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 0x7f353c06f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 >> v1:172.21.15.171:6789/0 conn(0x7f353c0b82b0 legacy=0x7f353c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c0b7400 con 0x7f353c06f6b0 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f35340019f0 con 0x7f353c06f6b0 2024-04-16T12:57:55.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 >> v1:172.21.15.106:6789/0 conn(0x7f353c06f6b0 legacy=0x7f353c06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35280039e0 0x7f3528003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 0x7f3528004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3528004d40 0x7f35280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0b9630 con 0x7f3528004d40 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f352800ba70 con 0x7f35280039e0 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.125+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f352800bc70 con 0x7f353c0b9d30 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3541664640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35280039e0 0x7f3528003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3541e65640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3528004d40 0x7f35280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3540e63640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 0x7f3528004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3541e65640 1 -- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 msgr2=0x7f3528004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3541e65640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c0b9d30 0x7f3528004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3541e65640 1 -- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35280039e0 msgr2=0x7f3528003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3541e65640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35280039e0 0x7f3528003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.126+0000 7f3541e65640 1 -- 172.21.15.106:0/2912660590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3528003520 con 0x7f3528004d40 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f3541e65640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3528004d40 0x7f35280051c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f353400a7c0 tx=0x7f3528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8580d6c7852b113 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353400a410 con 0x7f3528004d40 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3534034630 con 0x7f3528004d40 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f3533fff640 1 -- 172.21.15.106:0/2912660590 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534034a20 con 0x7f3528004d40 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f35438c8640 1 -- 172.21.15.106:0/2912660590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3528004d40 msgr2=0x7f35280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f35438c8640 1 --2- 172.21.15.106:0/2912660590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3528004d40 0x7f35280051c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f353400a7c0 tx=0x7f3528005830 comp rx=0 tx=0).stop 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f3541e65640 1 -- 172.21.15.106:0/2912660590 reap_dead start 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f35438c8640 1 -- 172.21.15.106:0/2912660590 shutdown_connections 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f35438c8640 1 -- 172.21.15.106:0/2912660590 >> 172.21.15.106:0/2912660590 conn(0x7f353c0ba4b0 msgr2=0x7f353c0ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f35438c8640 1 -- 172.21.15.106:0/2912660590 shutdown_connections 2024-04-16T12:57:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.127+0000 7f35438c8640 1 -- 172.21.15.106:0/2912660590 wait complete. 2024-04-16T12:57:55.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.128+0000 7f35438c8640 1 Processor -- start 2024-04-16T12:57:55.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.128+0000 7f35438c8640 1 -- start start 2024-04-16T12:57:55.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f35438c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c1e0820 0x7f353c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f35438c8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c1e0c00 0x7f353c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f35438c8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c0b0f00 0x7f353c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f35438c8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0bb340 con 0x7f353c0b0f00 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f35438c8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0b9350 con 0x7f353c1e0c00 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f35438c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f353c0ba110 con 0x7f353c1e0820 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c0b0f00 0x7f353c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c0b0f00 0x7f353c0b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48770/0 (socket says 172.21.15.106:48770) 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 -- 172.21.15.106:0/563689383 learned_addr learned my addr 172.21.15.106:0/563689383 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541664640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c1e0820 0x7f353c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3540e63640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c1e0c00 0x7f353c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 -- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c1e0820 msgr2=0x7f353c0b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c1e0820 0x7f353c0b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 -- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c1e0c00 msgr2=0x7f353c0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c1e0c00 0x7f353c0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.129+0000 7f3541e65640 1 -- 172.21.15.106:0/563689383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c1e16e0 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.130+0000 7f3541e65640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c0b0f00 0x7f353c0b1df0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f353400a8e0 tx=0x7f353c0b75d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.130+0000 7f3531ffb640 1 -- 172.21.15.106:0/563689383 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534001f50 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.130+0000 7f3531ffb640 1 -- 172.21.15.106:0/563689383 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3534045070 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.130+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c1e1120 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.130+0000 7f3531ffb640 1 -- 172.21.15.106:0/563689383 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534034c10 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.130+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c0b4730 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.131+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c068a90 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.131+0000 7f3531ffb640 1 -- 172.21.15.106:0/563689383 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f353404a460 con 0x7f353c0b0f00 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.132+0000 7f3531ffb640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f352006c8f0 0x7f352006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.132+0000 7f3541664640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f352006c8f0 0x7f352006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.132+0000 7f3531ffb640 1 -- 172.21.15.106:0/563689383 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f35340ad950 con 0x7f353c0b0f00 2024-04-16T12:57:55.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.132+0000 7f3541664640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f352006c8f0 0x7f352006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3538009bc0 tx=0x7f3538009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.136+0000 7f3531ffb640 1 -- 172.21.15.106:0/563689383 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f353407c340 con 0x7f353c0b0f00 2024-04-16T12:57:55.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.316+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f353c068a90 con 0x7f353c0b0f00 2024-04-16T12:57:55.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.317+0000 7f3531ffb640 1 -- 172.21.15.106:0/563689383 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+12891 (secure 0 0 0) 0x7f353407bc40 con 0x7f353c0b0f00 2024-04-16T12:57:55.318 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:55.319 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:52.386985+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:55.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f352006c8f0 msgr2=0x7f352006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f352006c8f0 0x7f352006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3538009bc0 tx=0x7f3538009190 comp rx=0 tx=0).stop 2024-04-16T12:57:55.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c0b0f00 msgr2=0x7f353c0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c0b0f00 0x7f353c0b1df0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f353400a8e0 tx=0x7f353c0b75d0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 shutdown_connections 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f352006c8f0 0x7f352006edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c0b0f00 0x7f353c0b1df0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c1e0c00 0x7f353c0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 --2- 172.21.15.106:0/563689383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c1e0820 0x7f353c0b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 >> 172.21.15.106:0/563689383 conn(0x7f353c0ba4b0 msgr2=0x7f353c0b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 shutdown_connections 2024-04-16T12:57:55.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.319+0000 7f35438c8640 1 -- 172.21.15.106:0/563689383 wait complete. 2024-04-16T12:57:55.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:57:06.180300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:57:55.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:57:55.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.438+0000 7f6effc7e640 1 Processor -- start 2024-04-16T12:57:55.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.438+0000 7f6effc7e640 1 -- start start 2024-04-16T12:57:55.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6effc7e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ef8148c30 0x7f6ef809eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6effc7e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6ef809cb60 0x7f6ef809f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6effc7e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef814c030 con 0x7f6ef814b6d0 2024-04-16T12:57:55.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6effc7e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef8148090 con 0x7f6ef8148c30 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6effc7e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef809d470 con 0x7f6ef809cb60 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6efd219640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ef8148c30 0x7f6ef809eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6efd219640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ef8148c30 0x7f6ef809eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48772/0 (socket says 172.21.15.106:48772) 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6efd219640 1 -- 172.21.15.106:0/227680394 learned_addr learned my addr 172.21.15.106:0/227680394 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.439+0000 7f6efe21b640 1 --2- 172.21.15.106:0/227680394 >> v2:172.21.15.171:3300/0 conn(0x7f6ef809cb60 0x7f6ef809f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efd219640 1 -- 172.21.15.106:0/227680394 >> v2:172.21.15.171:3300/0 conn(0x7f6ef809cb60 msgr2=0x7f6ef809f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efd219640 1 --2- 172.21.15.106:0/227680394 >> v2:172.21.15.171:3300/0 conn(0x7f6ef809cb60 0x7f6ef809f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efd219640 1 -- 172.21.15.106:0/227680394 >> v1:172.21.15.171:6789/0 conn(0x7f6ef814b6d0 legacy=0x7f6ef8148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efd219640 1 -- 172.21.15.106:0/227680394 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef814c310 con 0x7f6ef8148c30 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efd219640 1 --2- 172.21.15.106:0/227680394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef8148c30 0x7f6ef809eeb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b1100 tx=0x7f6eec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e34478bdbd7a39 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efca18640 1 -- 172.21.15.106:0/227680394 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec02e070 con 0x7f6ef8148c30 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efca18640 1 -- 172.21.15.106:0/227680394 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec037070 con 0x7f6ef8148c30 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.440+0000 7f6efca18640 1 -- 172.21.15.106:0/227680394 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec031a00 con 0x7f6ef8148c30 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 -- 172.21.15.106:0/227680394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef8148c30 msgr2=0x7f6ef809eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 --2- 172.21.15.106:0/227680394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef8148c30 0x7f6ef809eeb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b1100 tx=0x7f6eec02b880 comp rx=0 tx=0).stop 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 -- 172.21.15.106:0/227680394 shutdown_connections 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 --2- 172.21.15.106:0/227680394 >> v2:172.21.15.171:3300/0 conn(0x7f6ef809cb60 0x7f6ef809f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 --2- 172.21.15.106:0/227680394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef8148c30 0x7f6ef809eeb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 -- 172.21.15.106:0/227680394 >> 172.21.15.106:0/227680394 conn(0x7f6ef80ba080 msgr2=0x7f6ef80ba490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 -- 172.21.15.106:0/227680394 shutdown_connections 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.441+0000 7f6effc7e640 1 -- 172.21.15.106:0/227680394 wait complete. 2024-04-16T12:57:55.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.442+0000 7f6effc7e640 1 Processor -- start 2024-04-16T12:57:55.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.442+0000 7f6effc7e640 1 -- start start 2024-04-16T12:57:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef809cb60 0x7f6ef8145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef8148c30 0x7f6ef80bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef814b6d0 0x7f6ef813d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef814bc30 con 0x7f6ef809cb60 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef814bab0 con 0x7f6ef8148c30 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef814bdb0 con 0x7f6ef814b6d0 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef809cb60 0x7f6ef8145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef809cb60 0x7f6ef8145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48780/0 (socket says 172.21.15.106:48780) 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 -- 172.21.15.106:0/2001949074 learned_addr learned my addr 172.21.15.106:0/2001949074 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efd219640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef8148c30 0x7f6ef80bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efe21b640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef814b6d0 0x7f6ef813d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 -- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef814b6d0 msgr2=0x7f6ef813d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef814b6d0 0x7f6ef813d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 -- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef8148c30 msgr2=0x7f6ef80bbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef8148c30 0x7f6ef80bbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 -- 172.21.15.106:0/2001949074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef80bc0f0 con 0x7f6ef809cb60 2024-04-16T12:57:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efd219640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef8148c30 0x7f6ef80bbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6efda1a640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef809cb60 0x7f6ef8145750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800c6f0 tx=0x7f6ee800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6ef67fc640 1 -- 172.21.15.106:0/2001949074 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8003990 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6ef67fc640 1 -- 172.21.15.106:0/2001949074 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee8003b50 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef80bc3a0 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6ef67fc640 1 -- 172.21.15.106:0/2001949074 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800a850 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.443+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef813ec60 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.445+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef80b4450 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.445+0000 7f6ef67fc640 1 -- 172.21.15.106:0/2001949074 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ee800a9f0 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.445+0000 7f6ef67fc640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6ee406c920 0x7f6ee406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.445+0000 7f6ef67fc640 1 -- 172.21.15.106:0/2001949074 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f6ee808b600 con 0x7f6ef809cb60 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.445+0000 7f6efd219640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6ee406c920 0x7f6ee406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.446+0000 7f6efd219640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6ee406c920 0x7f6ee406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6eec036000 tx=0x7f6eec03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.450+0000 7f6ef67fc640 1 -- 172.21.15.106:0/2001949074 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ef80b4450 con 0x7f6ef809cb60 2024-04-16T12:57:55.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.626+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6ef80b99a0 con 0x7f6ef809cb60 2024-04-16T12:57:55.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.627+0000 7f6ef67fc640 1 -- 172.21.15.106:0/2001949074 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f6ef80b99a0 con 0x7f6ef809cb60 2024-04-16T12:57:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-16T12:57:55.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.628+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6ee406c920 msgr2=0x7f6ee406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.628+0000 7f6effc7e640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6ee406c920 0x7f6ee406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6eec036000 tx=0x7f6eec03d040 comp rx=0 tx=0).stop 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.628+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef809cb60 msgr2=0x7f6ef8145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.628+0000 7f6effc7e640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef809cb60 0x7f6ef8145750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800c6f0 tx=0x7f6ee800cbb0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 shutdown_connections 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f6ee406c920 0x7f6ee406ede0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef814b6d0 0x7f6ef813d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef8148c30 0x7f6ef80bbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 --2- 172.21.15.106:0/2001949074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ef809cb60 0x7f6ef8145750 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 >> 172.21.15.106:0/2001949074 conn(0x7f6ef80ba080 msgr2=0x7f6ef809b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 shutdown_connections 2024-04-16T12:57:55.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.629+0000 7f6effc7e640 1 -- 172.21.15.106:0/2001949074 wait complete. 2024-04-16T12:57:55.641 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T12:57:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.742+0000 7f2bb6a42640 1 Processor -- start 2024-04-16T12:57:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.742+0000 7f2bb6a42640 1 -- start start 2024-04-16T12:57:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2bb6a42640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 0x7f2bb006f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2bb6a42640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb006fb40 con 0x7f2bb00b82b0 2024-04-16T12:57:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2bb6a42640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb006c7d0 con 0x7f2bb006f6b0 2024-04-16T12:57:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2bb6a42640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb00b9630 con 0x7f2bb00b9d30 2024-04-16T12:57:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2ba7fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2bb00b82b0 0x7f2bb006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53136/0 (socket says 172.21.15.106:53136) 2024-04-16T12:57:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2ba7fff640 1 -- 172.21.15.106:0/2724876179 learned_addr learned my addr 172.21.15.106:0/2724876179 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2baffff640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 0x7f2bb006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225954214 0 0) 0x7f2bb006fb40 con 0x7f2bb00b82b0 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.743+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b9c003520 con 0x7f2bb00b82b0 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3988246400 0 0) 0x7f2b9c003520 con 0x7f2bb00b82b0 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 msgr2=0x7f2bb006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 0x7f2bb006f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 >> v1:172.21.15.171:6789/0 conn(0x7f2bb006f6b0 legacy=0x7f2bb006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb00b7400 con 0x7f2bb00b82b0 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f2b98001670 con 0x7f2bb00b82b0 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 >> v1:172.21.15.106:6789/0 conn(0x7f2bb00b82b0 legacy=0x7f2bb006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b9c0039e0 0x7f2b9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 0x7f2b9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b9c004d40 0x7f2b9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb00b9630 con 0x7f2b9c004d40 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c00baf0 con 0x7f2b9c0039e0 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9c00bcf0 con 0x7f2bb00b9d30 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2bb4fdf640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b9c004d40 0x7f2b9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2baffff640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b9c0039e0 0x7f2b9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2ba7fff640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 0x7f2b9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 msgr2=0x7f2b9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2bb4fdf640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bb00b9d30 0x7f2b9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b9c0039e0 msgr2=0x7f2b9c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2bb4fdf640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b9c0039e0 0x7f2b9c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.744+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/2724876179 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9c003520 con 0x7f2b9c004d40 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.745+0000 7f2bb4fdf640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b9c004d40 0x7f2b9c0051c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8001e50 tx=0x7f2b9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1107e6cb77632c72 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.745+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8001a70 con 0x7f2b9c004d40 2024-04-16T12:57:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.745+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8003b70 con 0x7f2b9c004d40 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.745+0000 7f2baf7fe640 1 -- 172.21.15.106:0/2724876179 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80050d0 con 0x7f2b9c004d40 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.746+0000 7f2bb6a42640 1 -- 172.21.15.106:0/2724876179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b9c004d40 msgr2=0x7f2b9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.746+0000 7f2bb6a42640 1 --2- 172.21.15.106:0/2724876179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b9c004d40 0x7f2b9c0051c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8001e50 tx=0x7f2b9c005830 comp rx=0 tx=0).stop 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.746+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/2724876179 reap_dead start 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.746+0000 7f2bb6a42640 1 -- 172.21.15.106:0/2724876179 shutdown_connections 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.746+0000 7f2bb6a42640 1 -- 172.21.15.106:0/2724876179 >> 172.21.15.106:0/2724876179 conn(0x7f2bb00ba4b0 msgr2=0x7f2bb00ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.746+0000 7f2bb6a42640 1 -- 172.21.15.106:0/2724876179 shutdown_connections 2024-04-16T12:57:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.746+0000 7f2bb6a42640 1 -- 172.21.15.106:0/2724876179 wait complete. 2024-04-16T12:57:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 Processor -- start 2024-04-16T12:57:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 -- start start 2024-04-16T12:57:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b9c004d40 0x7f2bb009a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bb01dd920 0x7f2bb01e1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bb01ce5e0 0x7f2bb01cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb00bb340 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb00b9350 con 0x7f2bb01dd920 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb6a42640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb00ba110 con 0x7f2b9c004d40 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.747+0000 7f2bb4fdf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bb01ce5e0 0x7f2bb01cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bb01ce5e0 0x7f2bb01cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48794/0 (socket says 172.21.15.106:48794) 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/3524523402 learned_addr learned my addr 172.21.15.106:0/3524523402 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2baffff640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b9c004d40 0x7f2bb009a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2ba7fff640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bb01dd920 0x7f2bb01e1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b9c004d40 msgr2=0x7f2bb009a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b9c004d40 0x7f2bb009a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bb01dd920 msgr2=0x7f2bb01e1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bb01dd920 0x7f2bb01e1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 -- 172.21.15.106:0/3524523402 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb01d3290 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb4fdf640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bb01ce5e0 0x7f2bb01cd990 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8001f70 tx=0x7f2ba80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bad7fa640 1 -- 172.21.15.106:0/3524523402 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8047070 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bad7fa640 1 -- 172.21.15.106:0/3524523402 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8006b50 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb01d2ff0 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bad7fa640 1 -- 172.21.15.106:0/3524523402 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8007db0 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.748+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb01e1300 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.749+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb0068a90 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.750+0000 7f2bad7fa640 1 -- 172.21.15.106:0/3524523402 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ba804a070 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.750+0000 7f2bad7fa640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2b9006c8f0 0x7f2b9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.750+0000 7f2bad7fa640 1 -- 172.21.15.106:0/3524523402 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7f2ba80acf90 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.750+0000 7f2baffff640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2b9006c8f0 0x7f2b9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.751+0000 7f2baffff640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2b9006c8f0 0x7f2b9006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00b2ea0 tx=0x7f2ba0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.755+0000 7f2bad7fa640 1 -- 172.21.15.106:0/3524523402 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ba8033020 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.931+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2bb00b48e0 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.932+0000 7f2bad7fa640 1 -- 172.21.15.106:0/3524523402 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v25) ==== 84+0+65 (secure 0 0 0) 0x7f2ba807b7a0 con 0x7f2bb01ce5e0 2024-04-16T12:57:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:55.934 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-04-16T12:57:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-16T12:57:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2024-04-16T12:57:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2024-04-16T12:57:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-16T12:57:55.934 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-04-16T12:57:55.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2b9006c8f0 msgr2=0x7f2b9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2b9006c8f0 0x7f2b9006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00b2ea0 tx=0x7f2ba0008040 comp rx=0 tx=0).stop 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bb01ce5e0 msgr2=0x7f2bb01cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bb01ce5e0 0x7f2bb01cd990 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8001f70 tx=0x7f2ba80014a0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 shutdown_connections 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f2b9006c8f0 0x7f2b9006edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bb01ce5e0 0x7f2bb01cd990 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bb01dd920 0x7f2bb01e1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 --2- 172.21.15.106:0/3524523402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b9c004d40 0x7f2bb009a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 >> 172.21.15.106:0/3524523402 conn(0x7f2bb00ba4b0 msgr2=0x7f2bb00ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 shutdown_connections 2024-04-16T12:57:55.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:55.934+0000 7f2bb6a42640 1 -- 172.21.15.106:0/3524523402 wait complete. 2024-04-16T12:57:55.946 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T12:57:55.947 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T12:57:56.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.052+0000 7fdbb2596640 1 Processor -- start 2024-04-16T12:57:56.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.052+0000 7fdbb2596640 1 -- start start 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb2596640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdbac09acd0 0x7fdbac148800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb2596640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdbac09de50 0x7fdbac150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb2596640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbac09b0b0 con 0x7fdbac148d40 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb2596640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fdbac06e5c0 con 0x7fdbac09de50 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb2596640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdbac09b670 con 0x7fdbac09acd0 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb0b33640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdbac09de50 0x7fdbac150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb0b33640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdbac09de50 0x7fdbac150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48802/0 (socket says 172.21.15.106:48802) 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb0b33640 1 -- 172.21.15.106:0/3176785485 learned_addr learned my addr 172.21.15.106:0/3176785485 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbabfff640 1 --2- 172.21.15.106:0/3176785485 >> v2:172.21.15.171:3300/0 conn(0x7fdbac09acd0 0x7fdbac148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb0b33640 1 -- 172.21.15.106:0/3176785485 >> v2:172.21.15.171:3300/0 conn(0x7fdbac09acd0 msgr2=0x7fdbac148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.053+0000 7fdbb0b33640 1 --2- 172.21.15.106:0/3176785485 >> v2:172.21.15.171:3300/0 conn(0x7fdbac09acd0 0x7fdbac148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.054+0000 7fdbb0b33640 1 -- 172.21.15.106:0/3176785485 >> v1:172.21.15.171:6789/0 conn(0x7fdbac148d40 legacy=0x7fdbac09d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.054+0000 7fdbb0b33640 1 -- 172.21.15.106:0/3176785485 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac09b950 con 0x7fdbac09de50 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.054+0000 7fdbb0b33640 1 --2- 172.21.15.106:0/3176785485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac09de50 0x7fdbac150530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdbac06f780 tx=0x7fdba402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a424466002f824 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.054+0000 7fdbab7fe640 1 -- 172.21.15.106:0/3176785485 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba402ca80 con 0x7fdbac09de50 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.054+0000 7fdbab7fe640 1 -- 172.21.15.106:0/3176785485 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba402cc20 con 0x7fdbac09de50 2024-04-16T12:57:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.054+0000 7fdbab7fe640 1 -- 172.21.15.106:0/3176785485 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba40343f0 con 0x7fdbac09de50 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 -- 172.21.15.106:0/3176785485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac09de50 msgr2=0x7fdbac150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 --2- 172.21.15.106:0/3176785485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac09de50 0x7fdbac150530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdbac06f780 tx=0x7fdba402bee0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 -- 172.21.15.106:0/3176785485 shutdown_connections 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 --2- 172.21.15.106:0/3176785485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac09de50 0x7fdbac150530 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 --2- 172.21.15.106:0/3176785485 >> v2:172.21.15.171:3300/0 conn(0x7fdbac09acd0 0x7fdbac148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 -- 172.21.15.106:0/3176785485 >> 172.21.15.106:0/3176785485 conn(0x7fdbac0b5e30 msgr2=0x7fdbac0b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 -- 172.21.15.106:0/3176785485 shutdown_connections 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.055+0000 7fdbb2596640 1 -- 172.21.15.106:0/3176785485 wait complete. 2024-04-16T12:57:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.056+0000 7fdbb2596640 1 Processor -- start 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.056+0000 7fdbb2596640 1 -- start start 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac09acd0 0x7fdbac0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbac09de50 0x7fdbac071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac148d40 0x7fdbac071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac0b5930 con 0x7fdbac148d40 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac0b5180 con 0x7fdbac09de50 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdbac0b5ab0 con 0x7fdbac09acd0 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac148d40 0x7fdbac071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac148d40 0x7fdbac071b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48806/0 (socket says 172.21.15.106:48806) 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 -- 172.21.15.106:0/1966039775 learned_addr learned my addr 172.21.15.106:0/1966039775 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbabfff640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac09acd0 0x7fdbac0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdba3fff640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbac09de50 0x7fdbac071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 -- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac09acd0 msgr2=0x7fdbac0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac09acd0 0x7fdbac0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 -- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbac09de50 msgr2=0x7fdbac071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbac09de50 0x7fdbac071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 -- 172.21.15.106:0/1966039775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac072670 con 0x7fdbac148d40 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb0b33640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac148d40 0x7fdbac071b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdba4036040 tx=0x7fdba4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdba97fa640 1 -- 172.21.15.106:0/1966039775 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4043020 con 0x7fdbac148d40 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdba97fa640 1 -- 172.21.15.106:0/1966039775 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba403e450 con 0x7fdbac148d40 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdba97fa640 1 -- 172.21.15.106:0/1966039775 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4009510 con 0x7fdbac148d40 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbac070b40 con 0x7fdbac148d40 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.057+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbac0b22d0 con 0x7fdbac148d40 2024-04-16T12:57:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.058+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbac068a90 con 0x7fdbac148d40 2024-04-16T12:57:56.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.059+0000 7fdba97fa640 1 -- 172.21.15.106:0/1966039775 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdba4046020 con 0x7fdbac148d40 2024-04-16T12:57:56.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.059+0000 7fdba97fa640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.059+0000 7fdba97fa640 1 -- 172.21.15.106:0/1966039775 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4857+0+0 (secure 0 0 0) 0x7fdba40adec0 con 0x7fdbac148d40 2024-04-16T12:57:56.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.059+0000 7fdbabfff640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.060+0000 7fdbabfff640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0079a0 tx=0x7fdb9c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:56.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.064+0000 7fdba97fa640 1 -- 172.21.15.106:0/1966039775 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdba404d030 con 0x7fdbac148d40 2024-04-16T12:57:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.239+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdbac0b7d90 con 0x7fdbac148d40 2024-04-16T12:57:56.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.396+0000 7fdba97fa640 1 -- 172.21.15.106:0/1966039775 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v26) ==== 138+0+0 (secure 0 0 0) 0x7fdba407bfe0 con 0x7fdbac148d40 2024-04-16T12:57:56.398 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2024-04-16T12:57:56.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb8c06c8f0 msgr2=0x7fdb8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0079a0 tx=0x7fdb9c008040 comp rx=0 tx=0).stop 2024-04-16T12:57:56.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac148d40 msgr2=0x7fdbac071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac148d40 0x7fdbac071b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdba4036040 tx=0x7fdba4004a40 comp rx=0 tx=0).stop 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 shutdown_connections 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb8c06c8f0 0x7fdb8c06edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbac148d40 0x7fdbac071b80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbac09de50 0x7fdbac071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.398+0000 7fdbb2596640 1 --2- 172.21.15.106:0/1966039775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac09acd0 0x7fdbac0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.399+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 >> 172.21.15.106:0/1966039775 conn(0x7fdbac0b5e30 msgr2=0x7fdbac074aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.399+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 shutdown_connections 2024-04-16T12:57:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.399+0000 7fdbb2596640 1 -- 172.21.15.106:0/1966039775 wait complete. 2024-04-16T12:57:56.413 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T12:57:56.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.522+0000 7f2934262640 1 Processor -- start 2024-04-16T12:57:56.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.522+0000 7f2934262640 1 -- start start 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2934262640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b3fe0 0x7f292c0b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2934262640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f292c0b1cc0 0x7f292c1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2934262640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f292c0b2120 0x7f292c148020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2934262640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f292c0b3860 con 0x7f292c0b2120 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2934262640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f292c0b43c0 con 0x7f292c0b1cc0 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2934262640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f292c073940 con 0x7f292c0b3fe0 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f292c0b2120 0x7f292c148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f292c0b2120 0x7f292c148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48816/0 (socket says 172.21.15.106:48816) 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 -- 172.21.15.106:0/2172644230 learned_addr learned my addr 172.21.15.106:0/2172644230 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:56.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2931ffe640 1 --2- 172.21.15.106:0/2172644230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b3fe0 0x7f292c0b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29317fd640 1 --2- 172.21.15.106:0/2172644230 >> v2:172.21.15.171:3300/0 conn(0x7f292c0b1cc0 0x7f292c1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 -- 172.21.15.106:0/2172644230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b3fe0 msgr2=0x7f292c0b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 --2- 172.21.15.106:0/2172644230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b3fe0 0x7f292c0b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 -- 172.21.15.106:0/2172644230 >> v2:172.21.15.171:3300/0 conn(0x7f292c0b1cc0 msgr2=0x7f292c1451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 --2- 172.21.15.106:0/2172644230 >> v2:172.21.15.171:3300/0 conn(0x7f292c0b1cc0 0x7f292c1451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29327ff640 1 -- 172.21.15.106:0/2172644230 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c073c20 con 0x7f292c0b2120 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f29317fd640 1 --2- 172.21.15.106:0/2172644230 >> v2:172.21.15.171:3300/0 conn(0x7f292c0b1cc0 0x7f292c1451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.523+0000 7f2931ffe640 1 --2- 172.21.15.106:0/2172644230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b3fe0 0x7f292c0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.524+0000 7f29327ff640 1 --2- 172.21.15.106:0/2172644230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b2120 0x7f292c148020 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b5dd0 tx=0x7f292402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7e0e4893c2fe26 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.524+0000 7f2930ffc640 1 -- 172.21.15.106:0/2172644230 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292402c9e0 con 0x7f292c0b2120 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.524+0000 7f2930ffc640 1 -- 172.21.15.106:0/2172644230 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292402cb80 con 0x7f292c0b2120 2024-04-16T12:57:56.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.524+0000 7f2930ffc640 1 -- 172.21.15.106:0/2172644230 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29240343f0 con 0x7f292c0b2120 2024-04-16T12:57:56.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 -- 172.21.15.106:0/2172644230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b2120 msgr2=0x7f292c148020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 --2- 172.21.15.106:0/2172644230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b2120 0x7f292c148020 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b5dd0 tx=0x7f292402be40 comp rx=0 tx=0).stop 2024-04-16T12:57:56.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 -- 172.21.15.106:0/2172644230 shutdown_connections 2024-04-16T12:57:56.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 --2- 172.21.15.106:0/2172644230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b2120 0x7f292c148020 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 --2- 172.21.15.106:0/2172644230 >> v2:172.21.15.171:3300/0 conn(0x7f292c0b1cc0 0x7f292c1451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 --2- 172.21.15.106:0/2172644230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b3fe0 0x7f292c0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 -- 172.21.15.106:0/2172644230 >> 172.21.15.106:0/2172644230 conn(0x7f292c0b9370 msgr2=0x7f292c0b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 -- 172.21.15.106:0/2172644230 shutdown_connections 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.525+0000 7f2934262640 1 -- 172.21.15.106:0/2172644230 wait complete. 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.526+0000 7f2934262640 1 Processor -- start 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.526+0000 7f2934262640 1 -- start start 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b1cc0 0x7f292c0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b2120 0x7f292c0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f292c0b3fe0 0x7f292c1cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f292c144c30 con 0x7f292c0b1cc0 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f292c144ab0 con 0x7f292c0b3fe0 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f292c0b2b30 con 0x7f292c0b2120 2024-04-16T12:57:56.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b1cc0 0x7f292c0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b1cc0 0x7f292c0b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48820/0 (socket says 172.21.15.106:48820) 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 -- 172.21.15.106:0/4108392275 learned_addr learned my addr 172.21.15.106:0/4108392275 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f29317fd640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b2120 0x7f292c0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f29327ff640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f292c0b3fe0 0x7f292c1cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 -- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b2120 msgr2=0x7f292c0a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b2120 0x7f292c0a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 -- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f292c0b3fe0 msgr2=0x7f292c1cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f292c0b3fe0 0x7f292c1cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 -- 172.21.15.106:0/4108392275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c1d10f0 con 0x7f292c0b1cc0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2931ffe640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b1cc0 0x7f292c0b4870 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f292800c7f0 tx=0x7f292800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f29227fc640 1 -- 172.21.15.106:0/4108392275 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928015070 con 0x7f292c0b1cc0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f29227fc640 1 -- 172.21.15.106:0/4108392275 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2928007820 con 0x7f292c0b1cc0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c0aa140 con 0x7f292c0b1cc0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f29227fc640 1 -- 172.21.15.106:0/4108392275 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928007bd0 con 0x7f292c0b1cc0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.527+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1d1390 con 0x7f292c0b1cc0 2024-04-16T12:57:56.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.528+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c068a90 con 0x7f292c0b1cc0 2024-04-16T12:57:56.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.529+0000 7f29227fc640 1 -- 172.21.15.106:0/4108392275 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2928018070 con 0x7f292c0b1cc0 2024-04-16T12:57:56.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.529+0000 7f29227fc640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f291006c8f0 0x7f291006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:56.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.529+0000 7f29227fc640 1 -- 172.21.15.106:0/4108392275 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5227+0+0 (secure 0 0 0) 0x7f292808b890 con 0x7f292c0b1cc0 2024-04-16T12:57:56.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.529+0000 7f29317fd640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f291006c8f0 0x7f291006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:56.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.530+0000 7f29317fd640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f291006c8f0 0x7f291006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b56e0 tx=0x7f291c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:56.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.534+0000 7f29227fc640 1 -- 172.21.15.106:0/4108392275 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29280598e0 con 0x7f292c0b1cc0 2024-04-16T12:57:56.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:56.708+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f292c073300 con 0x7f292c0b1cc0 2024-04-16T12:57:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.401+0000 7f29227fc640 1 -- 172.21.15.106:0/4108392275 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v27) ==== 170+0+0 (secure 0 0 0) 0x7f292805dbe0 con 0x7f292c0b1cc0 2024-04-16T12:57:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2024-04-16T12:57:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f291006c8f0 msgr2=0x7f291006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f291006c8f0 0x7f291006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b56e0 tx=0x7f291c008040 comp rx=0 tx=0).stop 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b1cc0 msgr2=0x7f292c0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b1cc0 0x7f292c0b4870 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f292800c7f0 tx=0x7f292800ccb0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 shutdown_connections 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f291006c8f0 0x7f291006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f292c0b3fe0 0x7f292c1cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f292c0b2120 0x7f292c0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.404+0000 7f2934262640 1 --2- 172.21.15.106:0/4108392275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c0b1cc0 0x7f292c0b4870 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.405+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 >> 172.21.15.106:0/4108392275 conn(0x7f292c0b9370 msgr2=0x7f292c1434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.406+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 shutdown_connections 2024-04-16T12:57:57.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.408+0000 7f2934262640 1 -- 172.21.15.106:0/4108392275 wait complete. 2024-04-16T12:57:57.432 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T12:57:57.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.538+0000 7ff151d8f640 1 Processor -- start 2024-04-16T12:57:57.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.538+0000 7ff151d8f640 1 -- start start 2024-04-16T12:57:57.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff151d8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c14b6d0 0x7ff14c148520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff151d8f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff14c09cb60 0x7ff14c148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff151d8f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14c14c030 con 0x7ff14c14bab0 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff151d8f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff14c148090 con 0x7ff14c09cb60 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff151d8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff14c09d470 con 0x7ff14c14b6d0 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14affd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff14c09cb60 0x7ff14c148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14affd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff14c09cb60 0x7ff14c148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48836/0 (socket says 172.21.15.106:48836) 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14affd640 1 -- 172.21.15.106:0/2789950006 learned_addr learned my addr 172.21.15.106:0/2789950006 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:57.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14b7fe640 1 --2- 172.21.15.106:0/2789950006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c14b6d0 0x7ff14c148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:57.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14affd640 1 -- 172.21.15.106:0/2789950006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c14b6d0 msgr2=0x7ff14c148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:57.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14affd640 1 --2- 172.21.15.106:0/2789950006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c14b6d0 0x7ff14c148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14affd640 1 -- 172.21.15.106:0/2789950006 >> v1:172.21.15.171:6789/0 conn(0x7ff14c14bab0 legacy=0x7ff14c09eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:57.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14affd640 1 -- 172.21.15.106:0/2789950006 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c14c310 con 0x7ff14c09cb60 2024-04-16T12:57:57.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.539+0000 7ff14b7fe640 1 --2- 172.21.15.106:0/2789950006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c14b6d0 0x7ff14c148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.540+0000 7ff14affd640 1 --2- 172.21.15.106:0/2789950006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c09cb60 0x7ff14c148a60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff140009870 tx=0x7ff14002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6e297ef5145d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.540+0000 7ff14a7fc640 1 -- 172.21.15.106:0/2789950006 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400317c0 con 0x7ff14c09cb60 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.540+0000 7ff14a7fc640 1 -- 172.21.15.106:0/2789950006 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff140037070 con 0x7ff14c09cb60 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.540+0000 7ff14a7fc640 1 -- 172.21.15.106:0/2789950006 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140031b80 con 0x7ff14c09cb60 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 -- 172.21.15.106:0/2789950006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c09cb60 msgr2=0x7ff14c148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 --2- 172.21.15.106:0/2789950006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c09cb60 0x7ff14c148a60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff140009870 tx=0x7ff14002b860 comp rx=0 tx=0).stop 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 -- 172.21.15.106:0/2789950006 shutdown_connections 2024-04-16T12:57:57.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 --2- 172.21.15.106:0/2789950006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c09cb60 0x7ff14c148a60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 --2- 172.21.15.106:0/2789950006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c14b6d0 0x7ff14c148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 -- 172.21.15.106:0/2789950006 >> 172.21.15.106:0/2789950006 conn(0x7ff14c0ba080 msgr2=0x7ff14c0ba490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 -- 172.21.15.106:0/2789950006 shutdown_connections 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.541+0000 7ff151d8f640 1 -- 172.21.15.106:0/2789950006 wait complete. 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.542+0000 7ff151d8f640 1 Processor -- start 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.542+0000 7ff151d8f640 1 -- start start 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff151d8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c09cb60 0x7ff14c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff151d8f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff14c14b6d0 0x7ff14c0a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff151d8f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c14bab0 0x7ff14c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff151d8f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c09f740 con 0x7ff14c14bab0 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff151d8f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c09f5c0 con 0x7ff14c14b6d0 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff151d8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff14c152790 con 0x7ff14c09cb60 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c14bab0 0x7ff14c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:57.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c14bab0 0x7ff14c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48842/0 (socket says 172.21.15.106:48842) 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 -- 172.21.15.106:0/218999808 learned_addr learned my addr 172.21.15.106:0/218999808 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14b7fe640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c09cb60 0x7ff14c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14affd640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff14c14b6d0 0x7ff14c0a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 -- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c09cb60 msgr2=0x7ff14c0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c09cb60 0x7ff14c0b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 -- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff14c14b6d0 msgr2=0x7ff14c0a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff14c14b6d0 0x7ff14c0a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 -- 172.21.15.106:0/218999808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c0b71a0 con 0x7ff14c14bab0 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff14bfff640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c14bab0 0x7ff14c0b1130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff14400c390 tx=0x7ff14400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.543+0000 7ff133fff640 1 -- 172.21.15.106:0/218999808 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144017070 con 0x7ff14c14bab0 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.544+0000 7ff133fff640 1 -- 172.21.15.106:0/218999808 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1440052d0 con 0x7ff14c14bab0 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.544+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c0b0980 con 0x7ff14c14bab0 2024-04-16T12:57:57.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.544+0000 7ff133fff640 1 -- 172.21.15.106:0/218999808 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144003810 con 0x7ff14c14bab0 2024-04-16T12:57:57.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.544+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c0b1670 con 0x7ff14c14bab0 2024-04-16T12:57:57.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.544+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14c068a90 con 0x7ff14c14bab0 2024-04-16T12:57:57.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.545+0000 7ff133fff640 1 -- 172.21.15.106:0/218999808 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff14401a070 con 0x7ff14c14bab0 2024-04-16T12:57:57.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.545+0000 7ff133fff640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff13806c8f0 0x7ff13806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:57.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.546+0000 7ff133fff640 1 -- 172.21.15.106:0/218999808 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5609+0+0 (secure 0 0 0) 0x7ff14408ad80 con 0x7ff14c14bab0 2024-04-16T12:57:57.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.546+0000 7ff14b7fe640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff13806c8f0 0x7ff13806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:57.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.546+0000 7ff14b7fe640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff13806c8f0 0x7ff13806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff13c003fd0 tx=0x7ff13c003ce0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:57.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.550+0000 7ff133fff640 1 -- 172.21.15.106:0/218999808 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff1440592a0 con 0x7ff14c14bab0 2024-04-16T12:57:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:57.764+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff14c0a3580 con 0x7ff14c14bab0 2024-04-16T12:57:58.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.413+0000 7ff133fff640 1 -- 172.21.15.106:0/218999808 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7ff144058ba0 con 0x7ff14c14bab0 2024-04-16T12:57:58.418 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 4 and data pool 5 2024-04-16T12:57:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.426+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff13806c8f0 msgr2=0x7ff13806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.426+0000 7ff151d8f640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff13806c8f0 0x7ff13806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff13c003fd0 tx=0x7ff13c003ce0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.426+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c14bab0 msgr2=0x7ff14c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.426+0000 7ff151d8f640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c14bab0 0x7ff14c0b1130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff14400c390 tx=0x7ff14400c850 comp rx=0 tx=0).stop 2024-04-16T12:57:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.428+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 shutdown_connections 2024-04-16T12:57:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.428+0000 7ff151d8f640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ff13806c8f0 0x7ff13806edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.428+0000 7ff151d8f640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff14c14bab0 0x7ff14c0b1130 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.428+0000 7ff151d8f640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff14c14b6d0 0x7ff14c0a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.428+0000 7ff151d8f640 1 --2- 172.21.15.106:0/218999808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff14c09cb60 0x7ff14c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.428+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 >> 172.21.15.106:0/218999808 conn(0x7ff14c0ba080 msgr2=0x7ff14c0b85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.429+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 shutdown_connections 2024-04-16T12:57:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.429+0000 7ff151d8f640 1 -- 172.21.15.106:0/218999808 wait complete. 2024-04-16T12:57:58.445 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:58.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.547+0000 7fe2eb0b3640 1 Processor -- start 2024-04-16T12:57:58.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.547+0000 7fe2eb0b3640 1 -- start start 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2eb0b3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe2e40b71b0 0x7fe2e4149230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2eb0b3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 0x7fe2e4145090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2eb0b3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e406f700 con 0x7fe2e40b82b0 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2eb0b3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e40b7590 con 0x7fe2e40b71b0 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2eb0b3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e40ba200 con 0x7fe2e4149770 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2e9650640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe2e40b82b0 0x7fe2e41455d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53150/0 (socket says 172.21.15.106:53150) 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2e9650640 1 -- 172.21.15.106:0/4200506717 learned_addr learned my addr 172.21.15.106:0/4200506717 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2dbfff640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 0x7fe2e4145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2e8e4f640 1 --2- 172.21.15.106:0/4200506717 >> v2:172.21.15.171:3300/0 conn(0x7fe2e40b71b0 0x7fe2e4149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423797410 0 0) 0x7fe2e406f700 con 0x7fe2e40b82b0 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2cc003520 con 0x7fe2e40b82b0 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 169907584 0 0) 0x7fe2cc003520 con 0x7fe2e40b82b0 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 msgr2=0x7fe2e4145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 0x7fe2e4145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 >> v2:172.21.15.171:3300/0 conn(0x7fe2e40b71b0 msgr2=0x7fe2e4149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 --2- 172.21.15.106:0/4200506717 >> v2:172.21.15.171:3300/0 conn(0x7fe2e40b71b0 0x7fe2e4149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e40b9570 con 0x7fe2e40b82b0 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fe2dc001a10 con 0x7fe2e40b82b0 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 >> v1:172.21.15.106:6789/0 conn(0x7fe2e40b82b0 legacy=0x7fe2e41455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2cc0039b0 0x7fe2cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 0x7fe2cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40b7590 con 0x7fe2cc004d40 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40ba200 con 0x7fe2cc0039b0 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe2cc00b9c0 con 0x7fe2e4149770 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2e9650640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2e8e4f640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2cc0039b0 0x7fe2cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.548+0000 7fe2dbfff640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 0x7fe2cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.549+0000 7fe2e9650640 1 -- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 msgr2=0x7fe2cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.549+0000 7fe2e9650640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e4149770 0x7fe2cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.549+0000 7fe2e9650640 1 -- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2cc0039b0 msgr2=0x7fe2cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.549+0000 7fe2e9650640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2cc0039b0 0x7fe2cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.549+0000 7fe2e9650640 1 -- 172.21.15.106:0/4200506717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc003520 con 0x7fe2cc004d40 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.549+0000 7fe2e9650640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2cc0051c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe2e406f8d0 tx=0x7fe2cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6109f6ab261c7a36 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.549+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00a500 con 0x7fe2cc004d40 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0072d0 con 0x7fe2cc004d40 2024-04-16T12:57:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2db7fe640 1 -- 172.21.15.106:0/4200506717 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0076c0 con 0x7fe2cc004d40 2024-04-16T12:57:58.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/4200506717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 msgr2=0x7fe2cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2eb0b3640 1 --2- 172.21.15.106:0/4200506717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2cc0051c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe2e406f8d0 tx=0x7fe2cc005830 comp rx=0 tx=0).stop 2024-04-16T12:57:58.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2e9650640 1 -- 172.21.15.106:0/4200506717 reap_dead start 2024-04-16T12:57:58.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/4200506717 shutdown_connections 2024-04-16T12:57:58.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/4200506717 >> 172.21.15.106:0/4200506717 conn(0x7fe2e40ba4b0 msgr2=0x7fe2e40ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:58.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/4200506717 shutdown_connections 2024-04-16T12:57:58.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.550+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/4200506717 wait complete. 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.551+0000 7fe2eb0b3640 1 Processor -- start 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.551+0000 7fe2eb0b3640 1 -- start start 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2eb0b3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2e41e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2eb0b3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2e4072f40 0x7fe2e40b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2eb0b3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e40b4040 0x7fe2e40afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2eb0b3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40b9ce0 con 0x7fe2cc004d40 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2eb0b3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40b9a40 con 0x7fe2e4072f40 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2eb0b3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e40b9290 con 0x7fe2e40b4040 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2e41e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2e41e09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48858/0 (socket says 172.21.15.106:48858) 2024-04-16T12:57:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 -- 172.21.15.106:0/3474585266 learned_addr learned my addr 172.21.15.106:0/3474585266 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2dbfff640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2e4072f40 0x7fe2e40b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e9650640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e40b4040 0x7fe2e40afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 -- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e40b4040 msgr2=0x7fe2e40afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e40b4040 0x7fe2e40afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 -- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2e4072f40 msgr2=0x7fe2e40b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2e4072f40 0x7fe2e40b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 -- 172.21.15.106:0/3474585266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e40b44c0 con 0x7fe2cc004d40 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2dbfff640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2e4072f40 0x7fe2e40b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.552+0000 7fe2e8e4f640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2e41e09f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0011960 tx=0x7fe2e0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:58.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.553+0000 7fe2d97fa640 1 -- 172.21.15.106:0/3474585266 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0009590 con 0x7fe2cc004d40 2024-04-16T12:57:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.553+0000 7fe2d97fa640 1 -- 172.21.15.106:0/3474585266 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e000fa90 con 0x7fe2cc004d40 2024-04-16T12:57:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.553+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e409ed70 con 0x7fe2cc004d40 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.553+0000 7fe2d97fa640 1 -- 172.21.15.106:0/3474585266 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000fe80 con 0x7fe2cc004d40 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.553+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e4072380 con 0x7fe2cc004d40 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.554+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4068a90 con 0x7fe2cc004d40 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.554+0000 7fe2d97fa640 1 -- 172.21.15.106:0/3474585266 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2e0012040 con 0x7fe2cc004d40 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.554+0000 7fe2d97fa640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe2d006c920 0x7fe2d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.555+0000 7fe2d97fa640 1 -- 172.21.15.106:0/3474585266 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5709+0+0 (secure 0 0 0) 0x7fe2e008c0b0 con 0x7fe2cc004d40 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.555+0000 7fe2dbfff640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe2d006c920 0x7fe2d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.555+0000 7fe2dbfff640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe2d006c920 0x7fe2d006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40a0a30 tx=0x7fe2d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.559+0000 7fe2d97fa640 1 -- 172.21.15.106:0/3474585266 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe2e0019030 con 0x7fe2cc004d40 2024-04-16T12:57:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.737+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2e40b78a0 con 0x7fe2cc004d40 2024-04-16T12:57:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.738+0000 7fe2d97fa640 1 -- 172.21.15.106:0/3474585266 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16682 (secure 0 0 0) 0x7fe2e005a570 con 0x7fe2cc004d40 2024-04-16T12:57:58.740 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:58.740 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":28,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:57.765599+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:56.243953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:56.712905+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe2d006c920 msgr2=0x7fe2d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe2d006c920 0x7fe2d006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40a0a30 tx=0x7fe2d4008040 comp rx=0 tx=0).stop 2024-04-16T12:57:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 msgr2=0x7fe2e41e09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2e41e09f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0011960 tx=0x7fe2e0011e20 comp rx=0 tx=0).stop 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 shutdown_connections 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe2d006c920 0x7fe2d006ede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2e40b4040 0x7fe2e40afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2e4072f40 0x7fe2e40b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 --2- 172.21.15.106:0/3474585266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2cc004d40 0x7fe2e41e09f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 >> 172.21.15.106:0/3474585266 conn(0x7fe2e40ba4b0 msgr2=0x7fe2e406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 shutdown_connections 2024-04-16T12:57:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.740+0000 7fe2eb0b3640 1 -- 172.21.15.106:0/3474585266 wait complete. 2024-04-16T12:57:58.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:57:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.854+0000 7ffa6d3d4640 1 Processor -- start 2024-04-16T12:57:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.854+0000 7ffa6d3d4640 1 -- start start 2024-04-16T12:57:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa6d3d4640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffa6814f730 0x7ffa68151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa6d3d4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680bc2b0 con 0x7ffa680bbed0 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa6d3d4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680af0f0 con 0x7ffa68148740 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa6d3d4640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680b2a50 con 0x7ffa6814f730 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa66ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffa680bbed0 0x7ffa680b53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53162/0 (socket says 172.21.15.106:53162) 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa66ffd640 1 -- 172.21.15.106:0/2545667505 learned_addr learned my addr 172.21.15.106:0/2545667505 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa677fe640 1 --2- 172.21.15.106:0/2545667505 >> v2:172.21.15.171:3300/0 conn(0x7ffa6814f730 0x7ffa68151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678413232 0 0) 0x7ffa680bc2b0 con 0x7ffa680bbed0 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa50003520 con 0x7ffa680bbed0 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1710635330 0 0) 0x7ffa50003520 con 0x7ffa680bbed0 2024-04-16T12:57:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 >> v2:172.21.15.171:3300/0 conn(0x7ffa6814f730 msgr2=0x7ffa68151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 --2- 172.21.15.106:0/2545667505 >> v2:172.21.15.171:3300/0 conn(0x7ffa6814f730 0x7ffa68151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 >> v1:172.21.15.171:6789/0 conn(0x7ffa68148740 legacy=0x7ffa68148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680b2ca0 con 0x7ffa680bbed0 2024-04-16T12:57:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7ffa580019f0 con 0x7ffa680bbed0 2024-04-16T12:57:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.855+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 >> v1:172.21.15.106:6789/0 conn(0x7ffa680bbed0 legacy=0x7ffa680b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa65ffb640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500039b0 0x7ffa50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa65ffb640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa500043b0 0x7ffa50004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa65ffb640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa50005120 0x7ffa5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680b2a50 con 0x7ffa500043b0 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5000c060 con 0x7ffa500039b0 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5000c260 con 0x7ffa50005120 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa667fc640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa500043b0 0x7ffa50004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa66ffd640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500039b0 0x7ffa50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa677fe640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa50005120 0x7ffa5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa667fc640 1 -- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa50005120 msgr2=0x7ffa5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa667fc640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa50005120 0x7ffa5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa667fc640 1 -- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500039b0 msgr2=0x7ffa50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa667fc640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500039b0 0x7ffa50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa667fc640 1 -- 172.21.15.106:0/2545667505 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa50003520 con 0x7ffa500043b0 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.856+0000 7ffa677fe640 1 -- 172.21.15.106:0/2545667505 reap_dead start 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa667fc640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa500043b0 0x7ffa50004880 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c001910 tx=0x7ffa50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc81cc9209373a77 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0014e0 con 0x7ffa500043b0 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c037070 con 0x7ffa500043b0 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa65ffb640 1 -- 172.21.15.106:0/2545667505 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c032860 con 0x7ffa500043b0 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/2545667505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa500043b0 msgr2=0x7ffa50004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa500043b0 0x7ffa50004880 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c001910 tx=0x7ffa50005830 comp rx=0 tx=0).stop 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/2545667505 shutdown_connections 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/2545667505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa500043b0 0x7ffa50004880 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/2545667505 >> 172.21.15.106:0/2545667505 conn(0x7ffa68067e20 msgr2=0x7ffa680bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/2545667505 shutdown_connections 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.857+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/2545667505 wait complete. 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.858+0000 7ffa6d3d4640 1 Processor -- start 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.858+0000 7ffa6d3d4640 1 -- start start 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa6d3d4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500043b0 0x7ffa68139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa6d3d4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa680b11b0 0x7ffa680ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa6d3d4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa681dda30 0x7ffa681ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa6d3d4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680b72e0 con 0x7ffa681dda30 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa6d3d4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680b5e50 con 0x7ffa500043b0 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa6d3d4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa680b42a0 con 0x7ffa680b11b0 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa681dda30 0x7ffa681ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa681dda30 0x7ffa681ddeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48872/0 (socket says 172.21.15.106:48872) 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 -- 172.21.15.106:0/3877798657 learned_addr learned my addr 172.21.15.106:0/3877798657 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa667fc640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa680b11b0 0x7ffa680ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa66ffd640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500043b0 0x7ffa68139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 -- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa680b11b0 msgr2=0x7ffa680ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa680b11b0 0x7ffa680ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 -- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500043b0 msgr2=0x7ffa68139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500043b0 0x7ffa68139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.859+0000 7ffa677fe640 1 -- 172.21.15.106:0/3877798657 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680b19e0 con 0x7ffa681dda30 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.860+0000 7ffa677fe640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa681dda30 0x7ffa681ddeb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa680b6e20 tx=0x7ffa60009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.860+0000 7ffa4f7fe640 1 -- 172.21.15.106:0/3877798657 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60015870 con 0x7ffa681dda30 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.860+0000 7ffa4f7fe640 1 -- 172.21.15.106:0/3877798657 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6001c070 con 0x7ffa681dda30 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.860+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa680b1700 con 0x7ffa681dda30 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.860+0000 7ffa4f7fe640 1 -- 172.21.15.106:0/3877798657 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60015c50 con 0x7ffa681dda30 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.860+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6806cac0 con 0x7ffa681dda30 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.861+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa68068a90 con 0x7ffa681dda30 2024-04-16T12:57:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.861+0000 7ffa4f7fe640 1 -- 172.21.15.106:0/3877798657 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa60021460 con 0x7ffa681dda30 2024-04-16T12:57:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.862+0000 7ffa4f7fe640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffa5406c920 0x7ffa5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.862+0000 7ffa66ffd640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffa5406c920 0x7ffa5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.862+0000 7ffa4f7fe640 1 -- 172.21.15.106:0/3877798657 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5709+0+0 (secure 0 0 0) 0x7ffa6008bba0 con 0x7ffa681dda30 2024-04-16T12:57:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.862+0000 7ffa66ffd640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffa5406c920 0x7ffa5406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa58002230 tx=0x7ffa58006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:58.866+0000 7ffa4f7fe640 1 -- 172.21.15.106:0/3877798657 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa60026020 con 0x7ffa681dda30 2024-04-16T12:57:59.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.046+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa681dd3b0 con 0x7ffa681dda30 2024-04-16T12:57:59.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.047+0000 7ffa4f7fe640 1 -- 172.21.15.106:0/3877798657 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16682 (secure 0 0 0) 0x7ffa60059a10 con 0x7ffa681dda30 2024-04-16T12:57:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:57:59.049 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":28,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:57.765599+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:56.243953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:56.712905+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:57:59.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffa5406c920 msgr2=0x7ffa5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffa5406c920 0x7ffa5406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa58002230 tx=0x7ffa58006040 comp rx=0 tx=0).stop 2024-04-16T12:57:59.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa681dda30 msgr2=0x7ffa681ddeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa681dda30 0x7ffa681ddeb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa680b6e20 tx=0x7ffa60009f90 comp rx=0 tx=0).stop 2024-04-16T12:57:59.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 shutdown_connections 2024-04-16T12:57:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffa5406c920 0x7ffa5406ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa681dda30 0x7ffa681ddeb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa680b11b0 0x7ffa680ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 --2- 172.21.15.106:0/3877798657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa500043b0 0x7ffa68139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 >> 172.21.15.106:0/3877798657 conn(0x7ffa68067e20 msgr2=0x7ffa680b9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 shutdown_connections 2024-04-16T12:57:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.049+0000 7ffa6d3d4640 1 -- 172.21.15.106:0/3877798657 wait complete. 2024-04-16T12:57:59.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T12:57:59.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.167+0000 7fa8d9bbd640 1 Processor -- start 2024-04-16T12:57:59.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.167+0000 7fa8d9bbd640 1 -- start start 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d9bbd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa8d40b2c80 0x7fa8d4073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d9bbd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d40b4f00 0x7fa8d413f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d9bbd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d40b3060 con 0x7fa8d4073c40 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d9bbd640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa8d40709e0 con 0x7fa8d40b2c80 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d9bbd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d4070fa0 con 0x7fa8d40b4f00 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d3fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa8d4073c40 0x7fa8d40b3d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53176/0 (socket says 172.21.15.106:53176) 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d3fff640 1 -- 172.21.15.106:0/3913675441 learned_addr learned my addr 172.21.15.106:0/3913675441 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d2ffd640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d40b4f00 0x7fa8d413f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/3913675441 >> v2:172.21.15.171:3300/0 conn(0x7fa8d40b2c80 0x7fa8d4073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745544360 0 0) 0x7fa8d40b3060 con 0x7fa8d4073c40 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.168+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8bc003520 con 0x7fa8d4073c40 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 769838691 0 0) 0x7fa8bc003520 con 0x7fa8d4073c40 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d40b4f00 msgr2=0x7fa8d413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d40b4f00 0x7fa8d413f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 >> v2:172.21.15.171:3300/0 conn(0x7fa8d40b2c80 msgr2=0x7fa8d4073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 --2- 172.21.15.106:0/3913675441 >> v2:172.21.15.171:3300/0 conn(0x7fa8d40b2c80 0x7fa8d4073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d4070c30 con 0x7fa8d4073c40 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fa8cc001670 con 0x7fa8d4073c40 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 >> v1:172.21.15.106:6789/0 conn(0x7fa8d4073c40 legacy=0x7fa8d40b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8bc0039b0 0x7fa8bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc004800 0x7fa8bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8bc005180 0x7fa8bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d40709e0 con 0x7fa8bc0039b0 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4070fa0 con 0x7fa8bc005180 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc004630 con 0x7fa8bc004800 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8bc0039b0 0x7fa8bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d2ffd640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc004800 0x7fa8bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d3fff640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8bc005180 0x7fa8bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d37fe640 1 -- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc004800 msgr2=0x7fa8bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc004800 0x7fa8bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d37fe640 1 -- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8bc005180 msgr2=0x7fa8bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8bc005180 0x7fa8bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d37fe640 1 -- 172.21.15.106:0/3913675441 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc003520 con 0x7fa8bc0039b0 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.169+0000 7fa8d3fff640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8bc005180 0x7fa8bc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:57:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8bc0039b0 0x7fa8bc003dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009fc0 tx=0x7fa8bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e59c19c1427ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4039070 con 0x7fa8bc0039b0 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c402cc60 con 0x7fa8bc0039b0 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d27fc640 1 -- 172.21.15.106:0/3913675441 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4009c10 con 0x7fa8bc0039b0 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/3913675441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8bc0039b0 msgr2=0x7fa8bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d9bbd640 1 --2- 172.21.15.106:0/3913675441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8bc0039b0 0x7fa8bc003dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009fc0 tx=0x7fa8bc005830 comp rx=0 tx=0).stop 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d3fff640 1 -- 172.21.15.106:0/3913675441 reap_dead start 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/3913675441 shutdown_connections 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.170+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/3913675441 >> 172.21.15.106:0/3913675441 conn(0x7fa8d406c510 msgr2=0x7fa8d40b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.171+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/3913675441 shutdown_connections 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.171+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/3913675441 wait complete. 2024-04-16T12:57:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 Processor -- start 2024-04-16T12:57:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 -- start start 2024-04-16T12:57:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc0039b0 0x7fa8d41376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4137c00 0x7fa8d41e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d41e1230 0x7fa8d41dd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d40703e0 con 0x7fa8d4137c00 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4070260 con 0x7fa8d41e1230 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d9bbd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d40b59a0 con 0x7fa8bc0039b0 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.172+0000 7fa8d2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4137c00 0x7fa8d41e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4137c00 0x7fa8d41e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48892/0 (socket says 172.21.15.106:48892) 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 -- 172.21.15.106:0/541026752 learned_addr learned my addr 172.21.15.106:0/541026752 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc0039b0 0x7fa8d41376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d3fff640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d41e1230 0x7fa8d41dd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 -- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc0039b0 msgr2=0x7fa8d41376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc0039b0 0x7fa8d41376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 -- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d41e1230 msgr2=0x7fa8d41dd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d41e1230 0x7fa8d41dd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 -- 172.21.15.106:0/541026752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d4144c80 con 0x7fa8d4137c00 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d2ffd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4137c00 0x7fa8d41e0cf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8011a00 tx=0x7fa8c8011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8bbfff640 1 -- 172.21.15.106:0/541026752 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800faf0 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8bbfff640 1 -- 172.21.15.106:0/541026752 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c800fc90 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8bbfff640 1 -- 172.21.15.106:0/541026752 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8014440 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d4149e50 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.173+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d4140b70 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.174+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d4068a90 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.175+0000 7fa8bbfff640 1 -- 172.21.15.106:0/541026752 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8c8012040 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.175+0000 7fa8bbfff640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa8c006c920 0x7fa8c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.175+0000 7fa8bbfff640 1 -- 172.21.15.106:0/541026752 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5709+0+0 (secure 0 0 0) 0x7fa8c808c130 con 0x7fa8d4137c00 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.175+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa8c006c920 0x7fa8c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.175+0000 7fa8d37fe640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa8c006c920 0x7fa8c006ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4036000 tx=0x7fa8c402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.179+0000 7fa8bbfff640 1 -- 172.21.15.106:0/541026752 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8c8019030 con 0x7fa8d4137c00 2024-04-16T12:57:59.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.391+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa8d413edb0 con 0x7fa8d4137c00 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fbc2c97d640 time 2024-04-16T12:57:59.423215+0000 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbc36d81f4c] 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.424 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr:2024-04-16T12:57:59.422+0000 7fbc2c97d640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fbc2c97d640 time 2024-04-16T12:57:59.423215+0000 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbc36d81f4c] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr:*** Caught signal (Aborted) ** 2024-04-16T12:57:59.425 INFO:tasks.ceph.mds.a.smithi106.stderr: in thread 7fbc2c97d640 thread_name:ms_dispatch 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbc36454db0] 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbc364a154c] 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: raise() 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: abort() 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbc36d81fa6] 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.426 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr:2024-04-16T12:57:59.423+0000 7fbc2c97d640 -1 *** Caught signal (Aborted) ** 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: in thread 7fbc2c97d640 thread_name:ms_dispatch 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbc36454db0] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbc364a154c] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: raise() 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: abort() 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbc36d81fa6] 2024-04-16T12:57:59.427 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.428 INFO:tasks.ceph.mds.a.smithi106.stderr: -1> 2024-04-16T12:57:59.422+0000 7fbc2c97d640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fbc2c97d640 time 2024-04-16T12:57:59.423215+0000 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbc36d81f4c] 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: 0> 2024-04-16T12:57:59.423+0000 7fbc2c97d640 -1 *** Caught signal (Aborted) ** 2024-04-16T12:57:59.429 INFO:tasks.ceph.mds.a.smithi106.stderr: in thread 7fbc2c97d640 thread_name:ms_dispatch 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbc36454db0] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbc364a154c] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: raise() 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: abort() 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbc36d81fa6] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.430 INFO:tasks.ceph.mds.a.smithi106.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: -1> 2024-04-16T12:57:59.422+0000 7fbc2c97d640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fbc2c97d640 time 2024-04-16T12:57:59.423215+0000 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbc36d81f4c] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.431 INFO:tasks.ceph.mds.a.smithi106.stderr: 0> 2024-04-16T12:57:59.423+0000 7fbc2c97d640 -1 *** Caught signal (Aborted) ** 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: in thread 7fbc2c97d640 thread_name:ms_dispatch 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbc36454db0] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbc364a154c] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 3: raise() 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 4: abort() 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbc36d81fa6] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fbc36d8210a] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 7: (MDLog::trim()+0xf2a) [0x55b30c3d11aa] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b30c3d1559] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fbc368db924] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fbc3649f802] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fbc3643f450] 2024-04-16T12:57:59.432 INFO:tasks.ceph.mds.a.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T12:57:59.433 INFO:tasks.ceph.mds.a.smithi106.stderr: 2024-04-16T12:57:59.712 INFO:tasks.ceph.mds.a.smithi106.stderr:daemon-helper: command crashed with signal 6 2024-04-16T12:57:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.789+0000 7fa8bbfff640 1 -- 172.21.15.106:0/541026752 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7fa8c805a5f0 con 0x7fa8d4137c00 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa8c006c920 msgr2=0x7fa8c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa8c006c920 0x7fa8c006ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4036000 tx=0x7fa8c402e000 comp rx=0 tx=0).stop 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4137c00 msgr2=0x7fa8d41e0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4137c00 0x7fa8d41e0cf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8011a00 tx=0x7fa8c8011ec0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 shutdown_connections 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa8c006c920 0x7fa8c006ede0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d41e1230 0x7fa8d41dd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4137c00 0x7fa8d41e0cf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 --2- 172.21.15.106:0/541026752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8bc0039b0 0x7fa8d41376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 >> 172.21.15.106:0/541026752 conn(0x7fa8d406c510 msgr2=0x7fa8d413b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 shutdown_connections 2024-04-16T12:57:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.791+0000 7fa8d9bbd640 1 -- 172.21.15.106:0/541026752 wait complete. 2024-04-16T12:57:59.804 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T12:57:59.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T12:57:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.909+0000 7fab4fac5640 1 Processor -- start 2024-04-16T12:57:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.909+0000 7fab4fac5640 1 -- start start 2024-04-16T12:57:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4fac5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fab48073430 0x7fab4806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4fac5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fab4806e570 0x7fab481489f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4fac5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab480b7c20 con 0x7fab480b5470 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4fac5640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fab480b6380 con 0x7fab48073430 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4fac5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fab480b5850 con 0x7fab4806e570 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4d060640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fab48073430 0x7fab4806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4d861640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fab480b5470 0x7fab481482e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53188/0 (socket says 172.21.15.106:53188) 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4d861640 1 -- 172.21.15.106:0/1299038098 learned_addr learned my addr 172.21.15.106:0/1299038098 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4e062640 1 --2- 172.21.15.106:0/1299038098 >> v2:172.21.15.171:3300/0 conn(0x7fab4806e570 0x7fab481489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4d060640 1 -- 172.21.15.106:0/1299038098 >> v2:172.21.15.171:3300/0 conn(0x7fab4806e570 msgr2=0x7fab481489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4d060640 1 --2- 172.21.15.106:0/1299038098 >> v2:172.21.15.171:3300/0 conn(0x7fab4806e570 0x7fab481489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4d060640 1 -- 172.21.15.106:0/1299038098 >> v1:172.21.15.106:6789/0 conn(0x7fab480b5470 legacy=0x7fab481482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4c85f640 1 -- 172.21.15.106:0/1299038098 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743176461 0 0) 0x7fab480b7c20 con 0x7fab480b5470 2024-04-16T12:57:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.910+0000 7fab4d060640 1 -- 172.21.15.106:0/1299038098 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4806ea20 con 0x7fab48073430 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4d060640 1 --2- 172.21.15.106:0/1299038098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4806d5d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0097a0 tx=0x7fab3c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee25d43a32be4b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4c85f640 1 -- 172.21.15.106:0/1299038098 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c038070 con 0x7fab48073430 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4c85f640 1 -- 172.21.15.106:0/1299038098 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c031700 con 0x7fab48073430 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4c85f640 1 -- 172.21.15.106:0/1299038098 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c031ad0 con 0x7fab48073430 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4fac5640 1 -- 172.21.15.106:0/1299038098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 msgr2=0x7fab4806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4fac5640 1 --2- 172.21.15.106:0/1299038098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4806d5d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0097a0 tx=0x7fab3c02b7a0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4fac5640 1 -- 172.21.15.106:0/1299038098 shutdown_connections 2024-04-16T12:57:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4fac5640 1 --2- 172.21.15.106:0/1299038098 >> v2:172.21.15.171:3300/0 conn(0x7fab4806e570 0x7fab481489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4fac5640 1 --2- 172.21.15.106:0/1299038098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4806d5d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.911+0000 7fab4fac5640 1 -- 172.21.15.106:0/1299038098 >> 172.21.15.106:0/1299038098 conn(0x7fab480b7f70 msgr2=0x7fab480b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:57:59.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.912+0000 7fab4fac5640 1 -- 172.21.15.106:0/1299038098 shutdown_connections 2024-04-16T12:57:59.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.912+0000 7fab4fac5640 1 -- 172.21.15.106:0/1299038098 wait complete. 2024-04-16T12:57:59.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.912+0000 7fab4fac5640 1 Processor -- start 2024-04-16T12:57:59.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4fac5640 1 -- start start 2024-04-16T12:57:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4fac5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab4806e570 0x7fab4813e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4fac5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4fac5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab480b5470 0x7fab4813f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4fac5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fab480b7570 con 0x7fab48073430 2024-04-16T12:57:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4fac5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab4806df90 con 0x7fab480b5470 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4fac5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fab48148f30 con 0x7fab4806e570 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4813eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48912/0 (socket says 172.21.15.106:48912) 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 -- 172.21.15.106:0/2205164914 learned_addr learned my addr 172.21.15.106:0/2205164914 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d861640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab4806e570 0x7fab4813e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4e062640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab480b5470 0x7fab4813f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 -- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab4806e570 msgr2=0x7fab4813e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab4806e570 0x7fab4813e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 -- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab480b5470 msgr2=0x7fab4813f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab480b5470 0x7fab4813f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.913+0000 7fab4d060640 1 -- 172.21.15.106:0/2205164914 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab481d2390 con 0x7fab48073430 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.914+0000 7fab4d060640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4813eb60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fab3c036040 tx=0x7fab3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.914+0000 7fab467fc640 1 -- 172.21.15.106:0/2205164914 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c042070 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.914+0000 7fab467fc640 1 -- 172.21.15.106:0/2205164914 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c03d950 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.914+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab48142340 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.914+0000 7fab467fc640 1 -- 172.21.15.106:0/2205164914 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c038040 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.914+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab481419a0 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.915+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab480691a0 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.915+0000 7fab467fc640 1 -- 172.21.15.106:0/2205164914 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab3c03b070 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.916+0000 7fab467fc640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fab3406c8f0 0x7fab3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.916+0000 7fab467fc640 1 -- 172.21.15.106:0/2205164914 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fab3c0ad2d0 con 0x7fab48073430 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.916+0000 7fab4d861640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fab3406c8f0 0x7fab3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:57:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.916+0000 7fab4d861640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fab3406c8f0 0x7fab3406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab380012e0 tx=0x7fab38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:57:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:57:59.920+0000 7fab467fc640 1 -- 172.21.15.106:0/2205164914 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab3c030070 con 0x7fab48073430 2024-04-16T12:58:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.136+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fab48147860 con 0x7fab48073430 2024-04-16T12:58:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.796+0000 7fab467fc640 1 -- 172.21.15.106:0/2205164914 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fab3c07b700 con 0x7fab48073430 2024-04-16T12:58:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fab3406c8f0 msgr2=0x7fab3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fab3406c8f0 0x7fab3406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab380012e0 tx=0x7fab38009040 comp rx=0 tx=0).stop 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 msgr2=0x7fab4813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4813eb60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fab3c036040 tx=0x7fab3c0046c0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 shutdown_connections 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fab3406c8f0 0x7fab3406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab480b5470 0x7fab4813f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab48073430 0x7fab4813eb60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 --2- 172.21.15.106:0/2205164914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab4806e570 0x7fab4813e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 >> 172.21.15.106:0/2205164914 conn(0x7fab480b7f70 msgr2=0x7fab48143f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 shutdown_connections 2024-04-16T12:58:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.798+0000 7fab4fac5640 1 -- 172.21.15.106:0/2205164914 wait complete. 2024-04-16T12:58:00.811 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T12:58:00.811 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:58:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.914+0000 7fb3bab52640 1 Processor -- start 2024-04-16T12:58:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.914+0000 7fb3bab52640 1 -- start start 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.914+0000 7fb3bab52640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb3b406db00 0x7fb3b40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.914+0000 7fb3bab52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41485f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.914+0000 7fb3bab52640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b40b44c0 con 0x7fb3b4148b30 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.914+0000 7fb3bab52640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b40ae4c0 con 0x7fb3b406db00 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.914+0000 7fb3bab52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b406dee0 con 0x7fb3b41481b0 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b88ee640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb3b406db00 0x7fb3b40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b88ee640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb3b406db00 0x7fb3b40b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48920/0 (socket says 172.21.15.106:48920) 2024-04-16T12:58:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b88ee640 1 -- 172.21.15.106:0/3924614179 learned_addr learned my addr 172.21.15.106:0/3924614179 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b3fff640 1 --2- 172.21.15.106:0/3924614179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b88ee640 1 -- 172.21.15.106:0/3924614179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 msgr2=0x7fb3b41485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b88ee640 1 --2- 172.21.15.106:0/3924614179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b88ee640 1 -- 172.21.15.106:0/3924614179 >> v1:172.21.15.171:6789/0 conn(0x7fb3b4148b30 legacy=0x7fb3b4144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.915+0000 7fb3b88ee640 1 -- 172.21.15.106:0/3924614179 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b4148fa0 con 0x7fb3b406db00 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3b88ee640 1 --2- 172.21.15.106:0/3924614179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b406db00 0x7fb3b40b3ea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009870 tx=0x7fb3a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b8e77c99e95220 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3b37fe640 1 -- 172.21.15.106:0/3924614179 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8035020 con 0x7fb3b406db00 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3b37fe640 1 -- 172.21.15.106:0/3924614179 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a8031640 con 0x7fb3b406db00 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3b37fe640 1 -- 172.21.15.106:0/3924614179 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a802d040 con 0x7fb3b406db00 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 -- 172.21.15.106:0/3924614179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b406db00 msgr2=0x7fb3b40b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 --2- 172.21.15.106:0/3924614179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b406db00 0x7fb3b40b3ea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009870 tx=0x7fb3a802b8f0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 -- 172.21.15.106:0/3924614179 shutdown_connections 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 --2- 172.21.15.106:0/3924614179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 --2- 172.21.15.106:0/3924614179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b406db00 0x7fb3b40b3ea0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 -- 172.21.15.106:0/3924614179 >> 172.21.15.106:0/3924614179 conn(0x7fb3b409cc10 msgr2=0x7fb3b406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:00.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 -- 172.21.15.106:0/3924614179 shutdown_connections 2024-04-16T12:58:00.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.916+0000 7fb3bab52640 1 -- 172.21.15.106:0/3924614179 wait complete. 2024-04-16T12:58:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.917+0000 7fb3bab52640 1 Processor -- start 2024-04-16T12:58:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.917+0000 7fb3bab52640 1 -- start start 2024-04-16T12:58:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3bab52640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3b406db00 0x7fb3b40b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3bab52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3bab52640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b4148b30 0x7fb3b41dbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3bab52640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b40b4e20 con 0x7fb3b4148b30 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3bab52640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b40aea80 con 0x7fb3b406db00 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3bab52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b40b5100 con 0x7fb3b41481b0 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b90ef640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b4148b30 0x7fb3b41dbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b90ef640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b4148b30 0x7fb3b41dbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48924/0 (socket says 172.21.15.106:48924) 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b90ef640 1 -- 172.21.15.106:0/4086301171 learned_addr learned my addr 172.21.15.106:0/4086301171 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b88ee640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3b406db00 0x7fb3b40b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b3fff640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b90ef640 1 -- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 msgr2=0x7fb3b41ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b90ef640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.918+0000 7fb3b90ef640 1 -- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3b406db00 msgr2=0x7fb3b40b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3b90ef640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3b406db00 0x7fb3b40b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3b90ef640 1 -- 172.21.15.106:0/4086301171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b4073540 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3b90ef640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b4148b30 0x7fb3b41dbba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c6b0 tx=0x7fb3ac00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3b17fa640 1 -- 172.21.15.106:0/4086301171 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac003b70 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3b17fa640 1 -- 172.21.15.106:0/4086301171 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac003d30 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b41cedb0 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3b17fa640 1 -- 172.21.15.106:0/4086301171 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac005310 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.919+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b40b3690 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.920+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b4068a90 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.920+0000 7fb3b17fa640 1 -- 172.21.15.106:0/4086301171 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3ac0054b0 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.921+0000 7fb3b17fa640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb39806c8f0 0x7fb39806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.921+0000 7fb3b88ee640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb39806c8f0 0x7fb39806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.921+0000 7fb3b17fa640 1 -- 172.21.15.106:0/4086301171 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fb3ac08b7c0 con 0x7fb3b4148b30 2024-04-16T12:58:00.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.921+0000 7fb3b88ee640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb39806c8f0 0x7fb39806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036000 tx=0x7fb3a803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:00.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:00.925+0000 7fb3b17fa640 1 -- 172.21.15.106:0/4086301171 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb3b40b44c0 con 0x7fb3b4148b30 2024-04-16T12:58:01.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.138+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3b406d460 con 0x7fb3b4148b30 2024-04-16T12:58:01.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.138+0000 7fb3b17fa640 1 -- 172.21.15.106:0/4086301171 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+3537 (secure 0 0 0) 0x7fb3ac059630 con 0x7fb3b4148b30 2024-04-16T12:58:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:01.140 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/2467066081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2467066081},{"type":"v1","addr":"172.21.15.171:6833","nonce":2467066081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:57.765565+0000","modified":"2024-04-16T12:58:00.138283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/4094660060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4094660060},{"type":"v1","addr":"172.21.15.106:6835","nonce":4094660060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4986,"qdb_cluster":[4986]},"id":2}]} 2024-04-16T12:58:01.140 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 14 2024-04-16T12:58:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb39806c8f0 msgr2=0x7fb39806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb39806c8f0 0x7fb39806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036000 tx=0x7fb3a803c040 comp rx=0 tx=0).stop 2024-04-16T12:58:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b4148b30 msgr2=0x7fb3b41dbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b4148b30 0x7fb3b41dbba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c6b0 tx=0x7fb3ac00cb70 comp rx=0 tx=0).stop 2024-04-16T12:58:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 shutdown_connections 2024-04-16T12:58:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fb39806c8f0 0x7fb39806edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b4148b30 0x7fb3b41dbba0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3b41481b0 0x7fb3b41ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 --2- 172.21.15.106:0/4086301171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3b406db00 0x7fb3b40b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 >> 172.21.15.106:0/4086301171 conn(0x7fb3b409cc10 msgr2=0x7fb3b406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 shutdown_connections 2024-04-16T12:58:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.140+0000 7fb3bab52640 1 -- 172.21.15.106:0/4086301171 wait complete. 2024-04-16T12:58:01.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:58:01.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.255+0000 7f8d1b39d640 1 Processor -- start 2024-04-16T12:58:01.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.256+0000 7f8d1b39d640 1 -- start start 2024-04-16T12:58:01.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.256+0000 7f8d1b39d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8d140bbe20 0x7f8d140b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.256+0000 7f8d1b39d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d140b3a80 con 0x7f8d141490c0 2024-04-16T12:58:01.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.256+0000 7f8d1b39d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d140bc200 con 0x7f8d141400c0 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.256+0000 7f8d1b39d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8d140b7cb0 con 0x7f8d140bbe20 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.256+0000 7f8d18938640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8d141490c0 0x7f8d1413f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53190/0 (socket says 172.21.15.106:53190) 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.256+0000 7f8d18938640 1 -- 172.21.15.106:0/715036895 learned_addr learned my addr 172.21.15.106:0/715036895 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270322360 0 0) 0x7f8d140b3a80 con 0x7f8d141490c0 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d19139640 1 --2- 172.21.15.106:0/715036895 >> v2:172.21.15.171:3300/0 conn(0x7f8d140bbe20 0x7f8d140b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d00003520 con 0x7f8d141490c0 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 629792800 0 0) 0x7f8d00003520 con 0x7f8d141490c0 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 >> v2:172.21.15.171:3300/0 conn(0x7f8d140bbe20 msgr2=0x7f8d140b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 --2- 172.21.15.106:0/715036895 >> v2:172.21.15.171:3300/0 conn(0x7f8d140bbe20 0x7f8d140b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 >> v1:172.21.15.171:6789/0 conn(0x7f8d141400c0 legacy=0x7f8d14150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d140b42b0 con 0x7f8d141490c0 2024-04-16T12:58:01.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f8d10001670 con 0x7f8d141490c0 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 >> v1:172.21.15.106:6789/0 conn(0x7f8d141490c0 legacy=0x7f8d1413f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d00004800 0x7f8d00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d000051c0 0x7f8d0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8d140b7cb0 con 0x7f8d000039b0 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0000c160 con 0x7f8d00004800 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0000c360 con 0x7f8d000051c0 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d19139640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d18938640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d00004800 0x7f8d00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d1993a640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d000051c0 0x7f8d0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d19139640 1 -- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d000051c0 msgr2=0x7f8d0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d19139640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d000051c0 0x7f8d0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d19139640 1 -- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d00004800 msgr2=0x7f8d00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:01.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d19139640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d00004800 0x7f8d00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d1993a640 1 -- 172.21.15.106:0/715036895 reap_dead start 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.257+0000 7f8d19139640 1 -- 172.21.15.106:0/715036895 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d00003520 con 0x7f8d000039b0 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.258+0000 7f8d19139640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d00003dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009ac0 tx=0x7f8d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af96ee187d7a1de2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.258+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08039070 con 0x7f8d000039b0 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.258+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0802c6b0 con 0x7f8d000039b0 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.258+0000 7f8d07fff640 1 -- 172.21.15.106:0/715036895 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08009690 con 0x7f8d000039b0 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.259+0000 7f8d1b39d640 1 -- 172.21.15.106:0/715036895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 msgr2=0x7f8d00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.259+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d00003dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009ac0 tx=0x7f8d00005830 comp rx=0 tx=0).stop 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.259+0000 7f8d1b39d640 1 -- 172.21.15.106:0/715036895 shutdown_connections 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.259+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/715036895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d00003dd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.259+0000 7f8d1b39d640 1 -- 172.21.15.106:0/715036895 >> 172.21.15.106:0/715036895 conn(0x7f8d14067e20 msgr2=0x7f8d140bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.259+0000 7f8d1b39d640 1 -- 172.21.15.106:0/715036895 shutdown_connections 2024-04-16T12:58:01.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.259+0000 7f8d1b39d640 1 -- 172.21.15.106:0/715036895 wait complete. 2024-04-16T12:58:01.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 Processor -- start 2024-04-16T12:58:01.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 -- start start 2024-04-16T12:58:01.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d14141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d141426f0 0x7f8d14142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d141dd950 0x7f8d141dddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8d140b4ab0 con 0x7f8d000039b0 2024-04-16T12:58:01.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d140b7960 con 0x7f8d141426f0 2024-04-16T12:58:01.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.260+0000 7f8d1b39d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d140b2450 con 0x7f8d141dd950 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d14141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d14141bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48946/0 (socket says 172.21.15.106:48946) 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 -- 172.21.15.106:0/2429643337 learned_addr learned my addr 172.21.15.106:0/2429643337 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d1993a640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d141dd950 0x7f8d141dddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d18938640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d141426f0 0x7f8d14142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 -- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d141dd950 msgr2=0x7f8d141dddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d141dd950 0x7f8d141dddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 -- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d141426f0 msgr2=0x7f8d14142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d141426f0 0x7f8d14142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 -- 172.21.15.106:0/2429643337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d141de310 con 0x7f8d000039b0 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d19139640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d14141bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8d08037040 tx=0x7f8d08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d05ffb640 1 -- 172.21.15.106:0/2429643337 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08042020 con 0x7f8d000039b0 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d05ffb640 1 -- 172.21.15.106:0/2429643337 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0803a040 con 0x7f8d000039b0 2024-04-16T12:58:01.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d141422d0 con 0x7f8d000039b0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d05ffb640 1 -- 172.21.15.106:0/2429643337 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08039070 con 0x7f8d000039b0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.261+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d14143470 con 0x7f8d000039b0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.262+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d140691a0 con 0x7f8d000039b0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.263+0000 7f8d05ffb640 1 -- 172.21.15.106:0/2429643337 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d08045020 con 0x7f8d000039b0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.263+0000 7f8d05ffb640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8cf806c8f0 0x7f8cf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.263+0000 7f8d05ffb640 1 -- 172.21.15.106:0/2429643337 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f8d080aceb0 con 0x7f8d000039b0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.263+0000 7f8d18938640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8cf806c8f0 0x7f8cf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.264+0000 7f8d18938640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8cf806c8f0 0x7f8cf806edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d14143a70 tx=0x7f8d10009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.268+0000 7f8d05ffb640 1 -- 172.21.15.106:0/2429643337 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d0804c070 con 0x7f8d000039b0 2024-04-16T12:58:01.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.446+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d14144730 con 0x7f8d000039b0 2024-04-16T12:58:01.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.447+0000 7f8d05ffb640 1 -- 172.21.15.106:0/2429643337 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16669 (secure 0 0 0) 0x7f8d08081070 con 0x7f8d000039b0 2024-04-16T12:58:01.449 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:01.449 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:59.404467+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:56.243953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:56.712905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:58:01.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.449+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8cf806c8f0 msgr2=0x7f8cf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.449+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8cf806c8f0 0x7f8cf806edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d14143a70 tx=0x7f8d10009040 comp rx=0 tx=0).stop 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.449+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 msgr2=0x7f8d14141bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.449+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d14141bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8d08037040 tx=0x7f8d08004730 comp rx=0 tx=0).stop 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 shutdown_connections 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f8cf806c8f0 0x7f8cf806edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d141dd950 0x7f8d141dddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d141426f0 0x7f8d14142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 --2- 172.21.15.106:0/2429643337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d000039b0 0x7f8d14141bb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 >> 172.21.15.106:0/2429643337 conn(0x7f8d14067e20 msgr2=0x7f8d140b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 shutdown_connections 2024-04-16T12:58:01.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.450+0000 7f8d1b39d640 1 -- 172.21.15.106:0/2429643337 wait complete. 2024-04-16T12:58:01.462 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T12:58:01.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.564+0000 7fa2290b8640 1 Processor -- start 2024-04-16T12:58:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.564+0000 7fa2290b8640 1 -- start start 2024-04-16T12:58:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.564+0000 7fa2290b8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa22406db00 0x7fa2240b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.564+0000 7fa2290b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa224148d30 0x7fa224145090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.564+0000 7fa2290b8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2240b44c0 con 0x7fa2241481b0 2024-04-16T12:58:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.564+0000 7fa2290b8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa2240ae4c0 con 0x7fa22406db00 2024-04-16T12:58:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.564+0000 7fa2290b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa22406dee0 con 0x7fa224148d30 2024-04-16T12:58:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa21a59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa2241481b0 0x7fa224148620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53204/0 (socket says 172.21.15.106:53204) 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa21a59c640 1 -- 172.21.15.106:0/1059127589 learned_addr learned my addr 172.21.15.106:0/1059127589 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa222d9d640 1 --2- 172.21.15.106:0/1059127589 >> v2:172.21.15.171:3300/0 conn(0x7fa22406db00 0x7fa2240b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa22359e640 1 --2- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa224148d30 0x7fa224145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa22259c640 1 -- 172.21.15.106:0/1059127589 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116805449 0 0) 0x7fa20c001110 con 0x7fa2241481b0 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa22259c640 1 -- 172.21.15.106:0/1059127589 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa210003520 con 0x7fa2241481b0 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa222d9d640 1 -- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa224148d30 msgr2=0x7fa224145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa222d9d640 1 --2- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa224148d30 0x7fa224145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa222d9d640 1 -- 172.21.15.106:0/1059127589 >> v1:172.21.15.106:6789/0 conn(0x7fa2241481b0 legacy=0x7fa224148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa22259c640 1 -- 172.21.15.106:0/1059127589 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1194810155 0 0) 0x7fa210003520 con 0x7fa2241481b0 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.565+0000 7fa222d9d640 1 -- 172.21.15.106:0/1059127589 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240b5620 con 0x7fa22406db00 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa222d9d640 1 --2- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22406db00 0x7fa2240b3ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa2140097a0 tx=0x7fa21402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65280e50bceb955 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa22259c640 1 -- 172.21.15.106:0/1059127589 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214037070 con 0x7fa22406db00 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa22259c640 1 -- 172.21.15.106:0/1059127589 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa214030510 con 0x7fa22406db00 2024-04-16T12:58:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa22259c640 1 -- 172.21.15.106:0/1059127589 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c001840 con 0x7fa22406db00 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa2290b8640 1 -- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22406db00 msgr2=0x7fa2240b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa2290b8640 1 --2- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22406db00 0x7fa2240b3ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa2140097a0 tx=0x7fa21402b710 comp rx=0 tx=0).stop 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa2290b8640 1 -- 172.21.15.106:0/1059127589 shutdown_connections 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa2290b8640 1 --2- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa224148d30 0x7fa224145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa2290b8640 1 --2- 172.21.15.106:0/1059127589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22406db00 0x7fa2240b3ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.566+0000 7fa2290b8640 1 -- 172.21.15.106:0/1059127589 >> 172.21.15.106:0/1059127589 conn(0x7fa22409cc10 msgr2=0x7fa22406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.567+0000 7fa2290b8640 1 -- 172.21.15.106:0/1059127589 shutdown_connections 2024-04-16T12:58:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.567+0000 7fa2290b8640 1 -- 172.21.15.106:0/1059127589 wait complete. 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 Processor -- start 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 -- start start 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22406db00 0x7fa2240b9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2241481b0 0x7fa2241dea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa224148d30 0x7fa22409d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240b5100 con 0x7fa224148d30 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240b4e20 con 0x7fa2241481b0 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa2290b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2240ae700 con 0x7fa22406db00 2024-04-16T12:58:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.568+0000 7fa22359e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa224148d30 0x7fa22409d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa224148d30 0x7fa22409d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48960/0 (socket says 172.21.15.106:48960) 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 -- 172.21.15.106:0/808287952 learned_addr learned my addr 172.21.15.106:0/808287952 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa21a59c640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2241481b0 0x7fa2241dea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa222d9d640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22406db00 0x7fa2240b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 -- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22406db00 msgr2=0x7fa2240b9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22406db00 0x7fa2240b9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 -- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2241481b0 msgr2=0x7fa2241dea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2241481b0 0x7fa2241dea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 -- 172.21.15.106:0/808287952 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240966b0 con 0x7fa224148d30 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa22359e640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa224148d30 0x7fa22409d660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00efc0 tx=0x7fa21c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa21bfff640 1 -- 172.21.15.106:0/808287952 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c018020 con 0x7fa224148d30 2024-04-16T12:58:01.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa21bfff640 1 -- 172.21.15.106:0/808287952 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c014480 con 0x7fa224148d30 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa224097310 con 0x7fa224148d30 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa21bfff640 1 -- 172.21.15.106:0/808287952 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c014870 con 0x7fa224148d30 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.569+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa224097f60 con 0x7fa224148d30 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.570+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa224068a90 con 0x7fa224148d30 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.571+0000 7fa21bfff640 1 -- 172.21.15.106:0/808287952 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa21c005d10 con 0x7fa224148d30 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.571+0000 7fa21bfff640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.571+0000 7fa21bfff640 1 -- 172.21.15.106:0/808287952 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fa21c08c3d0 con 0x7fa224148d30 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.571+0000 7fa222d9d640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.571+0000 7fa222d9d640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa20406c8f0 0x7fa20406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa214034000 tx=0x7fa214008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.575+0000 7fa21bfff640 1 -- 172.21.15.106:0/808287952 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa21c022070 con 0x7fa224148d30 2024-04-16T12:58:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.747+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2240afb80 con 0x7fa20406c8f0 2024-04-16T12:58:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.753+0000 7fa21bfff640 1 -- 172.21.15.106:0/808287952 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237191 (secure 0 0 0) 0x7fa2240afb80 con 0x7fa20406c8f0 2024-04-16T12:58:01.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa20406c8f0 msgr2=0x7fa20406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa20406c8f0 0x7fa20406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa214034000 tx=0x7fa214008030 comp rx=0 tx=0).stop 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa224148d30 msgr2=0x7fa22409d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa224148d30 0x7fa22409d660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00efc0 tx=0x7fa21c00c490 comp rx=0 tx=0).stop 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 shutdown_connections 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa224148d30 0x7fa22409d660 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2241481b0 0x7fa2241dea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 --2- 172.21.15.106:0/808287952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22406db00 0x7fa2240b9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.755+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 >> 172.21.15.106:0/808287952 conn(0x7fa22409cc10 msgr2=0x7fa2240af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.756+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 shutdown_connections 2024-04-16T12:58:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.756+0000 7fa2290b8640 1 -- 172.21.15.106:0/808287952 wait complete. 2024-04-16T12:58:01.768 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-16T12:58:00.173082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219488,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755232,"statfs":{"total":773094113280,"available":772869357568,"internally_reserved":0,"allocated":3383296,"data_stored":1971560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000547"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T12:57:52.390578+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:52.390578+0000","last_peered":"2024-04-16T12:57:52.390578+0000","last_clean":"2024-04-16T12:57:52.390578+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:52.390578+0000","last_undegraded":"2024-04-16T12:57:52.390578+0000","last_fullsized":"2024-04-16T12:57:52.390578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:01.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:01.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.911+0000 7f0dd4055640 1 Processor -- start 2024-04-16T12:58:01.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.911+0000 7f0dd4055640 1 -- start start 2024-04-16T12:58:01.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd4055640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0dcc0b3ea0 0x7f0dcc145090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd4055640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0dcc1488c0 0x7f0dcc14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd4055640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dcc0b44c0 con 0x7f0dcc06db00 2024-04-16T12:58:01.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd4055640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f0dcc0ae4c0 con 0x7f0dcc1488c0 2024-04-16T12:58:01.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd4055640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0dcc06dee0 con 0x7f0dcc0b3ea0 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd25f2640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0dcc1488c0 0x7f0dcc14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd1df1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0dcc06db00 0x7f0dcc1481b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53210/0 (socket says 172.21.15.106:53210) 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd1df1640 1 -- 172.21.15.106:0/1863181612 learned_addr learned my addr 172.21.15.106:0/1863181612 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.912+0000 7f0dd15f0640 1 --2- 172.21.15.106:0/1863181612 >> v2:172.21.15.171:3300/0 conn(0x7f0dcc0b3ea0 0x7f0dcc145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.913+0000 7f0dd25f2640 1 -- 172.21.15.106:0/1863181612 >> v2:172.21.15.171:3300/0 conn(0x7f0dcc0b3ea0 msgr2=0x7f0dcc145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.913+0000 7f0dd25f2640 1 --2- 172.21.15.106:0/1863181612 >> v2:172.21.15.171:3300/0 conn(0x7f0dcc0b3ea0 0x7f0dcc145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.913+0000 7f0dd25f2640 1 -- 172.21.15.106:0/1863181612 >> v1:172.21.15.106:6789/0 conn(0x7f0dcc06db00 legacy=0x7f0dcc1481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.913+0000 7f0dd0def640 1 -- 172.21.15.106:0/1863181612 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174275649 0 0) 0x7f0dc8001110 con 0x7f0dcc06db00 2024-04-16T12:58:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.913+0000 7f0dd25f2640 1 -- 172.21.15.106:0/1863181612 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc0b5620 con 0x7f0dcc1488c0 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.913+0000 7f0dd25f2640 1 --2- 172.21.15.106:0/1863181612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc14f4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0b0750 tx=0x7f0dc402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b171698a577ea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.913+0000 7f0dd0def640 1 -- 172.21.15.106:0/1863181612 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4039070 con 0x7f0dcc1488c0 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd0def640 1 -- 172.21.15.106:0/1863181612 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc402cbf0 con 0x7f0dcc1488c0 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd0def640 1 -- 172.21.15.106:0/1863181612 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4034440 con 0x7f0dcc1488c0 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 -- 172.21.15.106:0/1863181612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 msgr2=0x7f0dcc14f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1863181612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc14f4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0b0750 tx=0x7f0dc402be40 comp rx=0 tx=0).stop 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 -- 172.21.15.106:0/1863181612 shutdown_connections 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1863181612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc14f4e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1863181612 >> v2:172.21.15.171:3300/0 conn(0x7f0dcc0b3ea0 0x7f0dcc145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 -- 172.21.15.106:0/1863181612 >> 172.21.15.106:0/1863181612 conn(0x7f0dcc09cc10 msgr2=0x7f0dcc06d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 -- 172.21.15.106:0/1863181612 shutdown_connections 2024-04-16T12:58:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.914+0000 7f0dd4055640 1 -- 172.21.15.106:0/1863181612 wait complete. 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.915+0000 7f0dd4055640 1 Processor -- start 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.915+0000 7f0dd4055640 1 -- start start 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd4055640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc06db00 0x7f0dcc09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd4055640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dcc0b3ea0 0x7f0dcc0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd4055640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc09b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd4055640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc0b5100 con 0x7f0dcc1488c0 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd4055640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc0b4e20 con 0x7f0dcc06db00 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd4055640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0dcc0ae700 con 0x7f0dcc0b3ea0 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc09b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc09b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48972/0 (socket says 172.21.15.106:48972) 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 -- 172.21.15.106:0/1523617009 learned_addr learned my addr 172.21.15.106:0/1523617009 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd1df1640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc06db00 0x7f0dcc09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd15f0640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dcc0b3ea0 0x7f0dcc0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 -- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dcc0b3ea0 msgr2=0x7f0dcc0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dcc0b3ea0 0x7f0dcc0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 -- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc06db00 msgr2=0x7f0dcc09d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc06db00 0x7f0dcc09d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 -- 172.21.15.106:0/1523617009 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc09e520 con 0x7f0dcc1488c0 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd25f2640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc09b630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0dc402c450 tx=0x7f0dc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dc27fc640 1 -- 172.21.15.106:0/1523617009 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4039050 con 0x7f0dcc1488c0 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dc27fc640 1 -- 172.21.15.106:0/1523617009 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc4045070 con 0x7f0dcc1488c0 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.916+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc12fd00 con 0x7f0dcc1488c0 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.917+0000 7f0dc27fc640 1 -- 172.21.15.106:0/1523617009 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc403e830 con 0x7f0dcc1488c0 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.917+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc0b2940 con 0x7f0dcc1488c0 2024-04-16T12:58:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.917+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc068a90 con 0x7f0dcc1488c0 2024-04-16T12:58:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.918+0000 7f0dc27fc640 1 -- 172.21.15.106:0/1523617009 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0dc403e9d0 con 0x7f0dcc1488c0 2024-04-16T12:58:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.918+0000 7f0dc27fc640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0db006c920 0x7f0db006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.918+0000 7f0dc27fc640 1 -- 172.21.15.106:0/1523617009 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f0dc40ae7a0 con 0x7f0dcc1488c0 2024-04-16T12:58:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.919+0000 7f0dd1df1640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0db006c920 0x7f0db006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.919+0000 7f0dd1df1640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0db006c920 0x7f0db006ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000f60 tx=0x7f0dc8007970 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:01.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:01.923+0000 7f0dc27fc640 1 -- 172.21.15.106:0/1523617009 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0dc4032e20 con 0x7f0dcc1488c0 2024-04-16T12:58:02.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.095+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0dcc147960 con 0x7f0db006c920 2024-04-16T12:58:02.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.100+0000 7f0dc27fc640 1 -- 172.21.15.106:0/1523617009 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237191 (secure 0 0 0) 0x7f0dcc147960 con 0x7f0db006c920 2024-04-16T12:58:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:02.105 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0db006c920 msgr2=0x7f0db006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0db006c920 0x7f0db006ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000f60 tx=0x7f0dc8007970 comp rx=0 tx=0).stop 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 msgr2=0x7f0dcc09b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc09b630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0dc402c450 tx=0x7f0dc4004a40 comp rx=0 tx=0).stop 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 shutdown_connections 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f0db006c920 0x7f0db006ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dcc1488c0 0x7f0dcc09b630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dcc0b3ea0 0x7f0dcc0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 --2- 172.21.15.106:0/1523617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc06db00 0x7f0dcc09d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 >> 172.21.15.106:0/1523617009 conn(0x7f0dcc09cc10 msgr2=0x7f0dcc147060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:02.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 shutdown_connections 2024-04-16T12:58:02.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.103+0000 7f0dd4055640 1 -- 172.21.15.106:0/1523617009 wait complete. 2024-04-16T12:58:02.116 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-16T12:58:00.173082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219488,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755232,"statfs":{"total":773094113280,"available":772869357568,"internally_reserved":0,"allocated":3383296,"data_stored":1971560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000547"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:57.397957+0000","last_change":"2024-04-16T12:57:57.397957+0000","last_active":"2024-04-16T12:57:57.397957+0000","last_peered":"2024-04-16T12:57:57.397957+0000","last_clean":"2024-04-16T12:57:57.397957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:57.397957+0000","last_undegraded":"2024-04-16T12:57:57.397957+0000","last_fullsized":"2024-04-16T12:57:57.397957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T12:57:56.390200+0000","last_change":"2024-04-16T12:57:56.390200+0000","last_active":"2024-04-16T12:57:56.390200+0000","last_peered":"2024-04-16T12:57:56.390200+0000","last_clean":"2024-04-16T12:57:56.390200+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T12:57:56.390200+0000","last_undegraded":"2024-04-16T12:57:56.390200+0000","last_fullsized":"2024-04-16T12:57:56.390200+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T12:57:52.390578+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:52.390578+0000","last_peered":"2024-04-16T12:57:52.390578+0000","last_clean":"2024-04-16T12:57:52.390578+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:52.390578+0000","last_undegraded":"2024-04-16T12:57:52.390578+0000","last_fullsized":"2024-04-16T12:57:52.390578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":689221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:02.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:02.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.257+0000 7fd77c5a8640 1 Processor -- start 2024-04-16T12:58:02.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.257+0000 7fd77c5a8640 1 -- start start 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.258+0000 7fd77c5a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b53d0 0x7fd7740b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.258+0000 7fd77c5a8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7740b5d80 con 0x7fd7740b63a0 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.258+0000 7fd77c5a8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7741488d0 con 0x7fd7740b6780 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.258+0000 7fd77c5a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd774148b70 con 0x7fd7740b53d0 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.258+0000 7fd77a344640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd7740b63a0 0x7fd7741481c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53214/0 (socket says 172.21.15.106:53214) 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.258+0000 7fd77a344640 1 -- 172.21.15.106:0/2628791488 learned_addr learned my addr 172.21.15.106:0/2628791488 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.258+0000 7fd77ab45640 1 --2- 172.21.15.106:0/2628791488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b53d0 0x7fd7740b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.259+0000 7fd779342640 1 -- 172.21.15.106:0/2628791488 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439720837 0 0) 0x7fd7740b5d80 con 0x7fd7740b63a0 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.259+0000 7fd779342640 1 -- 172.21.15.106:0/2628791488 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd760003520 con 0x7fd7740b63a0 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.259+0000 7fd779342640 1 -- 172.21.15.106:0/2628791488 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244788789 0 0) 0x7fd7741488d0 con 0x7fd7740b6780 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.259+0000 7fd779342640 1 -- 172.21.15.106:0/2628791488 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7740b5d80 con 0x7fd7740b6780 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.259+0000 7fd77ab45640 1 -- 172.21.15.106:0/2628791488 >> v1:172.21.15.171:6789/0 conn(0x7fd7740b6780 legacy=0x7fd7741418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.259+0000 7fd77ab45640 1 -- 172.21.15.106:0/2628791488 >> v1:172.21.15.106:6789/0 conn(0x7fd7740b63a0 legacy=0x7fd7741481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.259+0000 7fd77ab45640 1 -- 172.21.15.106:0/2628791488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7740b4bd0 con 0x7fd7740b53d0 2024-04-16T12:58:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd77ab45640 1 --2- 172.21.15.106:0/2628791488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b53d0 0x7fd7740b5840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009dc0 tx=0x7fd76c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12860125ed9065a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd779342640 1 -- 172.21.15.106:0/2628791488 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c039070 con 0x7fd7740b53d0 2024-04-16T12:58:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd779342640 1 -- 172.21.15.106:0/2628791488 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76c02cc40 con 0x7fd7740b53d0 2024-04-16T12:58:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd779342640 1 -- 172.21.15.106:0/2628791488 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c034440 con 0x7fd7740b53d0 2024-04-16T12:58:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd77c5a8640 1 -- 172.21.15.106:0/2628791488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b53d0 msgr2=0x7fd7740b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/2628791488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b53d0 0x7fd7740b5840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009dc0 tx=0x7fd76c02be90 comp rx=0 tx=0).stop 2024-04-16T12:58:02.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd77c5a8640 1 -- 172.21.15.106:0/2628791488 shutdown_connections 2024-04-16T12:58:02.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/2628791488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b53d0 0x7fd7740b5840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.260+0000 7fd77c5a8640 1 -- 172.21.15.106:0/2628791488 >> 172.21.15.106:0/2628791488 conn(0x7fd774068080 msgr2=0x7fd7740bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:02.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.261+0000 7fd77c5a8640 1 -- 172.21.15.106:0/2628791488 shutdown_connections 2024-04-16T12:58:02.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.261+0000 7fd77c5a8640 1 -- 172.21.15.106:0/2628791488 wait complete. 2024-04-16T12:58:02.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.261+0000 7fd77c5a8640 1 Processor -- start 2024-04-16T12:58:02.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77c5a8640 1 -- start start 2024-04-16T12:58:02.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77c5a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7740b53d0 0x7fd774139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77c5a8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7740b63a0 0x7fd7741411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77c5a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b6780 0x7fd774141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77c5a8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd774142130 con 0x7fd7740b63a0 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77c5a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd774141fb0 con 0x7fd7740b53d0 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77c5a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd774153620 con 0x7fd7740b6780 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd779b43640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7740b63a0 0x7fd7741411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd779b43640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7740b63a0 0x7fd7741411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48988/0 (socket says 172.21.15.106:48988) 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd779b43640 1 -- 172.21.15.106:0/1637649949 learned_addr learned my addr 172.21.15.106:0/1637649949 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77a344640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7740b53d0 0x7fd774139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.262+0000 7fd77ab45640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b6780 0x7fd774141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd779b43640 1 -- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b6780 msgr2=0x7fd774141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd779b43640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b6780 0x7fd774141700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd779b43640 1 -- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7740b53d0 msgr2=0x7fd774139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd779b43640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7740b53d0 0x7fd774139b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd779b43640 1 -- 172.21.15.106:0/1637649949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd774140600 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd77a344640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7740b53d0 0x7fd774139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd779b43640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7740b63a0 0x7fd7741411c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c430 tx=0x7fd77000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd766ffd640 1 -- 172.21.15.106:0/1637649949 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770017070 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd766ffd640 1 -- 172.21.15.106:0/1637649949 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7700052f0 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd766ffd640 1 -- 172.21.15.106:0/1637649949 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770003830 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7741408e0 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.263+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7741451b0 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.264+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd77413fab0 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.264+0000 7fd766ffd640 1 -- 172.21.15.106:0/1637649949 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd77001a070 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.265+0000 7fd766ffd640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd75806c8f0 0x7fd75806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.265+0000 7fd77a344640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd75806c8f0 0x7fd75806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.265+0000 7fd766ffd640 1 -- 172.21.15.106:0/1637649949 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fd77008aea0 con 0x7fd7740b63a0 2024-04-16T12:58:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.265+0000 7fd77a344640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd75806c8f0 0x7fd75806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd7680011e0 tx=0x7fd768009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.269+0000 7fd766ffd640 1 -- 172.21.15.106:0/1637649949 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd77413fab0 con 0x7fd7740b63a0 2024-04-16T12:58:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.441+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd774068a90 con 0x7fd75806c8f0 2024-04-16T12:58:02.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.447+0000 7fd766ffd640 1 -- 172.21.15.106:0/1637649949 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fd774068a90 con 0x7fd75806c8f0 2024-04-16T12:58:02.451 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd75806c8f0 msgr2=0x7fd75806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd75806c8f0 0x7fd75806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd7680011e0 tx=0x7fd768009040 comp rx=0 tx=0).stop 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7740b63a0 msgr2=0x7fd7741411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7740b63a0 0x7fd7741411c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c430 tx=0x7fd77000c8f0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 shutdown_connections 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd75806c8f0 0x7fd75806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7740b6780 0x7fd774141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7740b63a0 0x7fd7741411c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 --2- 172.21.15.106:0/1637649949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7740b53d0 0x7fd774139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 >> 172.21.15.106:0/1637649949 conn(0x7fd774068080 msgr2=0x7fd7740bcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 shutdown_connections 2024-04-16T12:58:02.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.450+0000 7fd77c5a8640 1 -- 172.21.15.106:0/1637649949 wait complete. 2024-04-16T12:58:02.463 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-16T12:58:02.173349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.775509"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557061+0000","last_change":"2024-04-16T12:57:58.417066+0000","last_active":"2024-04-16T12:57:59.557061+0000","last_peered":"2024-04-16T12:57:59.557061+0000","last_clean":"2024-04-16T12:57:59.557061+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:57:59.557061+0000","last_undegraded":"2024-04-16T12:57:59.557061+0000","last_fullsized":"2024-04-16T12:57:59.557061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:40.783094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557293+0000","last_change":"2024-04-16T12:57:58.414223+0000","last_active":"2024-04-16T12:57:59.557293+0000","last_peered":"2024-04-16T12:57:59.557293+0000","last_clean":"2024-04-16T12:57:59.557293+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:57:59.557293+0000","last_undegraded":"2024-04-16T12:57:59.557293+0000","last_fullsized":"2024-04-16T12:57:59.557293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:04.064696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408863+0000","last_change":"2024-04-16T12:57:58.429706+0000","last_active":"2024-04-16T12:57:59.408863+0000","last_peered":"2024-04-16T12:57:59.408863+0000","last_clean":"2024-04-16T12:57:59.408863+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:57:59.408863+0000","last_undegraded":"2024-04-16T12:57:59.408863+0000","last_fullsized":"2024-04-16T12:57:59.408863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410150+0000","last_change":"2024-04-16T12:57:58.432119+0000","last_active":"2024-04-16T12:57:59.410150+0000","last_peered":"2024-04-16T12:57:59.410150+0000","last_clean":"2024-04-16T12:57:59.410150+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:57:59.410150+0000","last_undegraded":"2024-04-16T12:57:59.410150+0000","last_fullsized":"2024-04-16T12:57:59.410150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557573+0000","last_change":"2024-04-16T12:57:58.415012+0000","last_active":"2024-04-16T12:57:59.557573+0000","last_peered":"2024-04-16T12:57:59.557573+0000","last_clean":"2024-04-16T12:57:59.557573+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:57:59.557573+0000","last_undegraded":"2024-04-16T12:57:59.557573+0000","last_fullsized":"2024-04-16T12:57:59.557573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:02.447913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556831+0000","last_change":"2024-04-16T12:57:58.423617+0000","last_active":"2024-04-16T12:57:59.556831+0000","last_peered":"2024-04-16T12:57:59.556831+0000","last_clean":"2024-04-16T12:57:59.556831+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:57:59.556831+0000","last_undegraded":"2024-04-16T12:57:59.556831+0000","last_fullsized":"2024-04-16T12:57:59.556831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409523+0000","last_change":"2024-04-16T12:57:58.421176+0000","last_active":"2024-04-16T12:57:59.409523+0000","last_peered":"2024-04-16T12:57:59.409523+0000","last_clean":"2024-04-16T12:57:59.409523+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:57:59.409523+0000","last_undegraded":"2024-04-16T12:57:59.409523+0000","last_fullsized":"2024-04-16T12:57:59.409523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408717+0000","last_change":"2024-04-16T12:57:58.420336+0000","last_active":"2024-04-16T12:57:59.408717+0000","last_peered":"2024-04-16T12:57:59.408717+0000","last_clean":"2024-04-16T12:57:59.408717+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:57:59.408717+0000","last_undegraded":"2024-04-16T12:57:59.408717+0000","last_fullsized":"2024-04-16T12:57:59.408717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557536+0000","last_change":"2024-04-16T12:57:58.427221+0000","last_active":"2024-04-16T12:57:59.557536+0000","last_peered":"2024-04-16T12:57:59.557536+0000","last_clean":"2024-04-16T12:57:59.557536+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:57:59.557536+0000","last_undegraded":"2024-04-16T12:57:59.557536+0000","last_fullsized":"2024-04-16T12:57:59.557536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410349+0000","last_change":"2024-04-16T12:57:58.414532+0000","last_active":"2024-04-16T12:57:59.410349+0000","last_peered":"2024-04-16T12:57:59.410349+0000","last_clean":"2024-04-16T12:57:59.410349+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:57:59.410349+0000","last_undegraded":"2024-04-16T12:57:59.410349+0000","last_fullsized":"2024-04-16T12:57:59.410349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:33.604830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409656+0000","last_change":"2024-04-16T12:57:58.419590+0000","last_active":"2024-04-16T12:57:59.409656+0000","last_peered":"2024-04-16T12:57:59.409656+0000","last_clean":"2024-04-16T12:57:59.409656+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:57:59.409656+0000","last_undegraded":"2024-04-16T12:57:59.409656+0000","last_fullsized":"2024-04-16T12:57:59.409656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408763+0000","last_change":"2024-04-16T12:57:58.420968+0000","last_active":"2024-04-16T12:57:59.408763+0000","last_peered":"2024-04-16T12:57:59.408763+0000","last_clean":"2024-04-16T12:57:59.408763+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:57:59.408763+0000","last_undegraded":"2024-04-16T12:57:59.408763+0000","last_fullsized":"2024-04-16T12:57:59.408763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557659+0000","last_change":"2024-04-16T12:57:58.424597+0000","last_active":"2024-04-16T12:57:59.557659+0000","last_peered":"2024-04-16T12:57:59.557659+0000","last_clean":"2024-04-16T12:57:59.557659+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:57:59.557659+0000","last_undegraded":"2024-04-16T12:57:59.557659+0000","last_fullsized":"2024-04-16T12:57:59.557659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:58.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556986+0000","last_change":"2024-04-16T12:57:58.411816+0000","last_active":"2024-04-16T12:57:59.556986+0000","last_peered":"2024-04-16T12:57:59.556986+0000","last_clean":"2024-04-16T12:57:59.556986+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:57:59.556986+0000","last_undegraded":"2024-04-16T12:57:59.556986+0000","last_fullsized":"2024-04-16T12:57:59.556986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408901+0000","last_change":"2024-04-16T12:57:58.419271+0000","last_active":"2024-04-16T12:57:59.408901+0000","last_peered":"2024-04-16T12:57:59.408901+0000","last_clean":"2024-04-16T12:57:59.408901+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:57:59.408901+0000","last_undegraded":"2024-04-16T12:57:59.408901+0000","last_fullsized":"2024-04-16T12:57:59.408901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409323+0000","last_change":"2024-04-16T12:57:58.421606+0000","last_active":"2024-04-16T12:57:59.409323+0000","last_peered":"2024-04-16T12:57:59.409323+0000","last_clean":"2024-04-16T12:57:59.409323+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:57:59.409323+0000","last_undegraded":"2024-04-16T12:57:59.409323+0000","last_fullsized":"2024-04-16T12:57:59.409323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409307+0000","last_change":"2024-04-16T12:57:58.421726+0000","last_active":"2024-04-16T12:57:59.409307+0000","last_peered":"2024-04-16T12:57:59.409307+0000","last_clean":"2024-04-16T12:57:59.409307+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:57:59.409307+0000","last_undegraded":"2024-04-16T12:57:59.409307+0000","last_fullsized":"2024-04-16T12:57:59.409307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557302+0000","last_change":"2024-04-16T12:57:58.417403+0000","last_active":"2024-04-16T12:57:59.557302+0000","last_peered":"2024-04-16T12:57:59.557302+0000","last_clean":"2024-04-16T12:57:59.557302+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:57:59.557302+0000","last_undegraded":"2024-04-16T12:57:59.557302+0000","last_fullsized":"2024-04-16T12:57:59.557302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:24.189968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556932+0000","last_change":"2024-04-16T12:57:58.423377+0000","last_active":"2024-04-16T12:57:59.556932+0000","last_peered":"2024-04-16T12:57:59.556932+0000","last_clean":"2024-04-16T12:57:59.556932+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:57:59.556932+0000","last_undegraded":"2024-04-16T12:57:59.556932+0000","last_fullsized":"2024-04-16T12:57:59.556932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557686+0000","last_change":"2024-04-16T12:57:58.422790+0000","last_active":"2024-04-16T12:57:59.557686+0000","last_peered":"2024-04-16T12:57:59.557686+0000","last_clean":"2024-04-16T12:57:59.557686+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:57:59.557686+0000","last_undegraded":"2024-04-16T12:57:59.557686+0000","last_fullsized":"2024-04-16T12:57:59.557686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:04.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557897+0000","last_change":"2024-04-16T12:57:58.432630+0000","last_active":"2024-04-16T12:57:59.557897+0000","last_peered":"2024-04-16T12:57:59.557897+0000","last_clean":"2024-04-16T12:57:59.557897+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:57:59.557897+0000","last_undegraded":"2024-04-16T12:57:59.557897+0000","last_fullsized":"2024-04-16T12:57:59.557897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557157+0000","last_change":"2024-04-16T12:57:58.428165+0000","last_active":"2024-04-16T12:57:59.557157+0000","last_peered":"2024-04-16T12:57:59.557157+0000","last_clean":"2024-04-16T12:57:59.557157+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:57:59.557157+0000","last_undegraded":"2024-04-16T12:57:59.557157+0000","last_fullsized":"2024-04-16T12:57:59.557157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556657+0000","last_change":"2024-04-16T12:57:58.419322+0000","last_active":"2024-04-16T12:57:59.556657+0000","last_peered":"2024-04-16T12:57:59.556657+0000","last_clean":"2024-04-16T12:57:59.556657+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:57:59.556657+0000","last_undegraded":"2024-04-16T12:57:59.556657+0000","last_fullsized":"2024-04-16T12:57:59.556657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408594+0000","last_change":"2024-04-16T12:57:58.425245+0000","last_active":"2024-04-16T12:57:59.408594+0000","last_peered":"2024-04-16T12:57:59.408594+0000","last_clean":"2024-04-16T12:57:59.408594+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:57:59.408594+0000","last_undegraded":"2024-04-16T12:57:59.408594+0000","last_fullsized":"2024-04-16T12:57:59.408594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410326+0000","last_change":"2024-04-16T12:57:58.422256+0000","last_active":"2024-04-16T12:57:59.410326+0000","last_peered":"2024-04-16T12:57:59.410326+0000","last_clean":"2024-04-16T12:57:59.410326+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:57:59.410326+0000","last_undegraded":"2024-04-16T12:57:59.410326+0000","last_fullsized":"2024-04-16T12:57:59.410326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557449+0000","last_change":"2024-04-16T12:57:58.421697+0000","last_active":"2024-04-16T12:57:59.557449+0000","last_peered":"2024-04-16T12:57:59.557449+0000","last_clean":"2024-04-16T12:57:59.557449+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:57:59.557449+0000","last_undegraded":"2024-04-16T12:57:59.557449+0000","last_fullsized":"2024-04-16T12:57:59.557449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:39.008329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410430+0000","last_change":"2024-04-16T12:57:58.429064+0000","last_active":"2024-04-16T12:57:59.410430+0000","last_peered":"2024-04-16T12:57:59.410430+0000","last_clean":"2024-04-16T12:57:59.410430+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:57:59.410430+0000","last_undegraded":"2024-04-16T12:57:59.410430+0000","last_fullsized":"2024-04-16T12:57:59.410430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408814+0000","last_change":"2024-04-16T12:57:58.420144+0000","last_active":"2024-04-16T12:57:59.408814+0000","last_peered":"2024-04-16T12:57:59.408814+0000","last_clean":"2024-04-16T12:57:59.408814+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:57:59.408814+0000","last_undegraded":"2024-04-16T12:57:59.408814+0000","last_fullsized":"2024-04-16T12:57:59.408814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557851+0000","last_change":"2024-04-16T12:57:58.428551+0000","last_active":"2024-04-16T12:57:59.557851+0000","last_peered":"2024-04-16T12:57:59.557851+0000","last_clean":"2024-04-16T12:57:59.557851+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:57:59.557851+0000","last_undegraded":"2024-04-16T12:57:59.557851+0000","last_fullsized":"2024-04-16T12:57:59.557851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408962+0000","last_change":"2024-04-16T12:57:58.419164+0000","last_active":"2024-04-16T12:57:59.408962+0000","last_peered":"2024-04-16T12:57:59.408962+0000","last_clean":"2024-04-16T12:57:59.408962+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:57:59.408962+0000","last_undegraded":"2024-04-16T12:57:59.408962+0000","last_fullsized":"2024-04-16T12:57:59.408962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557022+0000","last_change":"2024-04-16T12:57:58.417480+0000","last_active":"2024-04-16T12:57:59.557022+0000","last_peered":"2024-04-16T12:57:59.557022+0000","last_clean":"2024-04-16T12:57:59.557022+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:57:59.557022+0000","last_undegraded":"2024-04-16T12:57:59.557022+0000","last_fullsized":"2024-04-16T12:57:59.557022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:55:29.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408880+0000","last_change":"2024-04-16T12:57:58.429121+0000","last_active":"2024-04-16T12:57:59.408880+0000","last_peered":"2024-04-16T12:57:59.408880+0000","last_clean":"2024-04-16T12:57:59.408880+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:57:59.408880+0000","last_undegraded":"2024-04-16T12:57:59.408880+0000","last_fullsized":"2024-04-16T12:57:59.408880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.529728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557103+0000","last_change":"2024-04-16T12:57:58.425769+0000","last_active":"2024-04-16T12:57:59.557103+0000","last_peered":"2024-04-16T12:57:59.557103+0000","last_clean":"2024-04-16T12:57:59.557103+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:57:59.557103+0000","last_undegraded":"2024-04-16T12:57:59.557103+0000","last_fullsized":"2024-04-16T12:57:59.557103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557168+0000","last_change":"2024-04-16T12:57:57.419875+0000","last_active":"2024-04-16T12:57:59.557168+0000","last_peered":"2024-04-16T12:57:59.557168+0000","last_clean":"2024-04-16T12:57:59.557168+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:57:59.557168+0000","last_undegraded":"2024-04-16T12:57:59.557168+0000","last_fullsized":"2024-04-16T12:57:59.557168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556949+0000","last_change":"2024-04-16T12:57:58.429507+0000","last_active":"2024-04-16T12:57:59.556949+0000","last_peered":"2024-04-16T12:57:59.556949+0000","last_clean":"2024-04-16T12:57:59.556949+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:57:59.556949+0000","last_undegraded":"2024-04-16T12:57:59.556949+0000","last_fullsized":"2024-04-16T12:57:59.556949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:48.320225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557195+0000","last_change":"2024-04-16T12:57:57.409560+0000","last_active":"2024-04-16T12:57:59.557195+0000","last_peered":"2024-04-16T12:57:59.557195+0000","last_clean":"2024-04-16T12:57:59.557195+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:57:59.557195+0000","last_undegraded":"2024-04-16T12:57:59.557195+0000","last_fullsized":"2024-04-16T12:57:59.557195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557564+0000","last_change":"2024-04-16T12:57:58.430344+0000","last_active":"2024-04-16T12:57:59.557564+0000","last_peered":"2024-04-16T12:57:59.557564+0000","last_clean":"2024-04-16T12:57:59.557564+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:57:59.557564+0000","last_undegraded":"2024-04-16T12:57:59.557564+0000","last_fullsized":"2024-04-16T12:57:59.557564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557003+0000","last_change":"2024-04-16T12:57:57.421388+0000","last_active":"2024-04-16T12:57:59.557003+0000","last_peered":"2024-04-16T12:57:59.557003+0000","last_clean":"2024-04-16T12:57:59.557003+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:57:59.557003+0000","last_undegraded":"2024-04-16T12:57:59.557003+0000","last_fullsized":"2024-04-16T12:57:59.557003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:23.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410459+0000","last_change":"2024-04-16T12:57:58.427164+0000","last_active":"2024-04-16T12:57:59.410459+0000","last_peered":"2024-04-16T12:57:59.410459+0000","last_clean":"2024-04-16T12:57:59.410459+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:57:59.410459+0000","last_undegraded":"2024-04-16T12:57:59.410459+0000","last_fullsized":"2024-04-16T12:57:59.410459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557793+0000","last_change":"2024-04-16T12:57:57.419891+0000","last_active":"2024-04-16T12:57:59.557793+0000","last_peered":"2024-04-16T12:57:59.557793+0000","last_clean":"2024-04-16T12:57:59.557793+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:57:59.557793+0000","last_undegraded":"2024-04-16T12:57:59.557793+0000","last_fullsized":"2024-04-16T12:57:59.557793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:48.386771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409438+0000","last_change":"2024-04-16T12:57:58.428187+0000","last_active":"2024-04-16T12:57:59.409438+0000","last_peered":"2024-04-16T12:57:59.409438+0000","last_clean":"2024-04-16T12:57:59.409438+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:57:59.409438+0000","last_undegraded":"2024-04-16T12:57:59.409438+0000","last_fullsized":"2024-04-16T12:57:59.409438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557927+0000","last_change":"2024-04-16T12:57:57.419136+0000","last_active":"2024-04-16T12:57:59.557927+0000","last_peered":"2024-04-16T12:57:59.557927+0000","last_clean":"2024-04-16T12:57:59.557927+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:57:59.557927+0000","last_undegraded":"2024-04-16T12:57:59.557927+0000","last_fullsized":"2024-04-16T12:57:59.557927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408786+0000","last_change":"2024-04-16T12:57:58.428624+0000","last_active":"2024-04-16T12:57:59.408786+0000","last_peered":"2024-04-16T12:57:59.408786+0000","last_clean":"2024-04-16T12:57:59.408786+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:57:59.408786+0000","last_undegraded":"2024-04-16T12:57:59.408786+0000","last_fullsized":"2024-04-16T12:57:59.408786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557287+0000","last_change":"2024-04-16T12:57:57.418607+0000","last_active":"2024-04-16T12:57:59.557287+0000","last_peered":"2024-04-16T12:57:59.557287+0000","last_clean":"2024-04-16T12:57:59.557287+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:57:59.557287+0000","last_undegraded":"2024-04-16T12:57:59.557287+0000","last_fullsized":"2024-04-16T12:57:59.557287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:17.248246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556971+0000","last_change":"2024-04-16T12:57:58.426553+0000","last_active":"2024-04-16T12:57:59.556971+0000","last_peered":"2024-04-16T12:57:59.556971+0000","last_clean":"2024-04-16T12:57:59.556971+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:57:59.556971+0000","last_undegraded":"2024-04-16T12:57:59.556971+0000","last_fullsized":"2024-04-16T12:57:59.556971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556800+0000","last_change":"2024-04-16T12:57:57.418496+0000","last_active":"2024-04-16T12:57:59.556800+0000","last_peered":"2024-04-16T12:57:59.556800+0000","last_clean":"2024-04-16T12:57:59.556800+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:57:59.556800+0000","last_undegraded":"2024-04-16T12:57:59.556800+0000","last_fullsized":"2024-04-16T12:57:59.556800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409997+0000","last_change":"2024-04-16T12:57:58.421803+0000","last_active":"2024-04-16T12:57:59.409997+0000","last_peered":"2024-04-16T12:57:59.409997+0000","last_clean":"2024-04-16T12:57:59.409997+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:57:59.409997+0000","last_undegraded":"2024-04-16T12:57:59.409997+0000","last_fullsized":"2024-04-16T12:57:59.409997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557158+0000","last_change":"2024-04-16T12:57:57.417993+0000","last_active":"2024-04-16T12:57:59.557158+0000","last_peered":"2024-04-16T12:57:59.557158+0000","last_clean":"2024-04-16T12:57:59.557158+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:57:59.557158+0000","last_undegraded":"2024-04-16T12:57:59.557158+0000","last_fullsized":"2024-04-16T12:57:59.557158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:27:27.583239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409611+0000","last_change":"2024-04-16T12:57:58.421729+0000","last_active":"2024-04-16T12:57:59.409611+0000","last_peered":"2024-04-16T12:57:59.409611+0000","last_clean":"2024-04-16T12:57:59.409611+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:57:59.409611+0000","last_undegraded":"2024-04-16T12:57:59.409611+0000","last_fullsized":"2024-04-16T12:57:59.409611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556740+0000","last_change":"2024-04-16T12:57:57.419936+0000","last_active":"2024-04-16T12:57:59.556740+0000","last_peered":"2024-04-16T12:57:59.556740+0000","last_clean":"2024-04-16T12:57:59.556740+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:57:59.556740+0000","last_undegraded":"2024-04-16T12:57:59.556740+0000","last_fullsized":"2024-04-16T12:57:59.556740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:09.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556761+0000","last_change":"2024-04-16T12:57:58.423776+0000","last_active":"2024-04-16T12:57:59.556761+0000","last_peered":"2024-04-16T12:57:59.556761+0000","last_clean":"2024-04-16T12:57:59.556761+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:57:59.556761+0000","last_undegraded":"2024-04-16T12:57:59.556761+0000","last_fullsized":"2024-04-16T12:57:59.556761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557282+0000","last_change":"2024-04-16T12:57:57.418768+0000","last_active":"2024-04-16T12:57:59.557282+0000","last_peered":"2024-04-16T12:57:59.557282+0000","last_clean":"2024-04-16T12:57:59.557282+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:57:59.557282+0000","last_undegraded":"2024-04-16T12:57:59.557282+0000","last_fullsized":"2024-04-16T12:57:59.557282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557137+0000","last_change":"2024-04-16T12:57:58.421105+0000","last_active":"2024-04-16T12:57:59.557137+0000","last_peered":"2024-04-16T12:57:59.557137+0000","last_clean":"2024-04-16T12:57:59.557137+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:57:59.557137+0000","last_undegraded":"2024-04-16T12:57:59.557137+0000","last_fullsized":"2024-04-16T12:57:59.557137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408991+0000","last_change":"2024-04-16T12:57:57.416238+0000","last_active":"2024-04-16T12:57:59.408991+0000","last_peered":"2024-04-16T12:57:59.408991+0000","last_clean":"2024-04-16T12:57:59.408991+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:57:59.408991+0000","last_undegraded":"2024-04-16T12:57:59.408991+0000","last_fullsized":"2024-04-16T12:57:59.408991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408608+0000","last_change":"2024-04-16T12:57:58.428014+0000","last_active":"2024-04-16T12:57:59.408608+0000","last_peered":"2024-04-16T12:57:59.408608+0000","last_clean":"2024-04-16T12:57:59.408608+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:57:59.408608+0000","last_undegraded":"2024-04-16T12:57:59.408608+0000","last_fullsized":"2024-04-16T12:57:59.408608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557150+0000","last_change":"2024-04-16T12:57:57.421382+0000","last_active":"2024-04-16T12:57:59.557150+0000","last_peered":"2024-04-16T12:57:59.557150+0000","last_clean":"2024-04-16T12:57:59.557150+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:57:59.557150+0000","last_undegraded":"2024-04-16T12:57:59.557150+0000","last_fullsized":"2024-04-16T12:57:59.557150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:09.260220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410034+0000","last_change":"2024-04-16T12:57:58.417617+0000","last_active":"2024-04-16T12:57:59.410034+0000","last_peered":"2024-04-16T12:57:59.410034+0000","last_clean":"2024-04-16T12:57:59.410034+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:57:59.410034+0000","last_undegraded":"2024-04-16T12:57:59.410034+0000","last_fullsized":"2024-04-16T12:57:59.410034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.558015+0000","last_change":"2024-04-16T12:57:57.419094+0000","last_active":"2024-04-16T12:57:59.558015+0000","last_peered":"2024-04-16T12:57:59.558015+0000","last_clean":"2024-04-16T12:57:59.558015+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:57:59.558015+0000","last_undegraded":"2024-04-16T12:57:59.558015+0000","last_fullsized":"2024-04-16T12:57:59.558015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557010+0000","last_change":"2024-04-16T12:57:58.414688+0000","last_active":"2024-04-16T12:57:59.557010+0000","last_peered":"2024-04-16T12:57:59.557010+0000","last_clean":"2024-04-16T12:57:59.557010+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:57:59.557010+0000","last_undegraded":"2024-04-16T12:57:59.557010+0000","last_fullsized":"2024-04-16T12:57:59.557010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410019+0000","last_change":"2024-04-16T12:57:57.416542+0000","last_active":"2024-04-16T12:57:59.410019+0000","last_peered":"2024-04-16T12:57:59.410019+0000","last_clean":"2024-04-16T12:57:59.410019+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:57:59.410019+0000","last_undegraded":"2024-04-16T12:57:59.410019+0000","last_fullsized":"2024-04-16T12:57:59.410019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409146+0000","last_change":"2024-04-16T12:57:58.429363+0000","last_active":"2024-04-16T12:57:59.409146+0000","last_peered":"2024-04-16T12:57:59.409146+0000","last_clean":"2024-04-16T12:57:59.409146+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:57:59.409146+0000","last_undegraded":"2024-04-16T12:57:59.409146+0000","last_fullsized":"2024-04-16T12:57:59.409146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557034+0000","last_change":"2024-04-16T12:57:57.417272+0000","last_active":"2024-04-16T12:57:59.557034+0000","last_peered":"2024-04-16T12:57:59.557034+0000","last_clean":"2024-04-16T12:57:59.557034+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:57:59.557034+0000","last_undegraded":"2024-04-16T12:57:59.557034+0000","last_fullsized":"2024-04-16T12:57:59.557034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:19.085142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:58.428318+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556658+0000","last_change":"2024-04-16T12:57:57.418665+0000","last_active":"2024-04-16T12:57:59.556658+0000","last_peered":"2024-04-16T12:57:59.556658+0000","last_clean":"2024-04-16T12:57:59.556658+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:57:59.556658+0000","last_undegraded":"2024-04-16T12:57:59.556658+0000","last_fullsized":"2024-04-16T12:57:59.556658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:39.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557740+0000","last_change":"2024-04-16T12:57:58.424884+0000","last_active":"2024-04-16T12:57:59.557740+0000","last_peered":"2024-04-16T12:57:59.557740+0000","last_clean":"2024-04-16T12:57:59.557740+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:57:59.557740+0000","last_undegraded":"2024-04-16T12:57:59.557740+0000","last_fullsized":"2024-04-16T12:57:59.557740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410365+0000","last_change":"2024-04-16T12:57:57.417511+0000","last_active":"2024-04-16T12:57:59.410365+0000","last_peered":"2024-04-16T12:57:59.410365+0000","last_clean":"2024-04-16T12:57:59.410365+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:57:59.410365+0000","last_undegraded":"2024-04-16T12:57:59.410365+0000","last_fullsized":"2024-04-16T12:57:59.410365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409706+0000","last_change":"2024-04-16T12:57:58.431315+0000","last_active":"2024-04-16T12:57:59.409706+0000","last_peered":"2024-04-16T12:57:59.409706+0000","last_clean":"2024-04-16T12:57:59.409706+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:57:59.409706+0000","last_undegraded":"2024-04-16T12:57:59.409706+0000","last_fullsized":"2024-04-16T12:57:59.409706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557710+0000","last_change":"2024-04-16T12:57:57.419368+0000","last_active":"2024-04-16T12:57:59.557710+0000","last_peered":"2024-04-16T12:57:59.557710+0000","last_clean":"2024-04-16T12:57:59.557710+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:57:59.557710+0000","last_undegraded":"2024-04-16T12:57:59.557710+0000","last_fullsized":"2024-04-16T12:57:59.557710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410299+0000","last_change":"2024-04-16T12:57:58.431490+0000","last_active":"2024-04-16T12:57:59.410299+0000","last_peered":"2024-04-16T12:57:59.410299+0000","last_clean":"2024-04-16T12:57:59.410299+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:57:59.410299+0000","last_undegraded":"2024-04-16T12:57:59.410299+0000","last_fullsized":"2024-04-16T12:57:59.410299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557329+0000","last_change":"2024-04-16T12:57:57.418637+0000","last_active":"2024-04-16T12:57:59.557329+0000","last_peered":"2024-04-16T12:57:59.557329+0000","last_clean":"2024-04-16T12:57:59.557329+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:57:59.557329+0000","last_undegraded":"2024-04-16T12:57:59.557329+0000","last_fullsized":"2024-04-16T12:57:59.557329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:49.553356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557676+0000","last_change":"2024-04-16T12:57:58.420291+0000","last_active":"2024-04-16T12:57:59.557676+0000","last_peered":"2024-04-16T12:57:59.557676+0000","last_clean":"2024-04-16T12:57:59.557676+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:57:59.557676+0000","last_undegraded":"2024-04-16T12:57:59.557676+0000","last_fullsized":"2024-04-16T12:57:59.557676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557561+0000","last_change":"2024-04-16T12:57:57.420173+0000","last_active":"2024-04-16T12:57:59.557561+0000","last_peered":"2024-04-16T12:57:59.557561+0000","last_clean":"2024-04-16T12:57:59.557561+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:57:59.557561+0000","last_undegraded":"2024-04-16T12:57:59.557561+0000","last_fullsized":"2024-04-16T12:57:59.557561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:01.440156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556745+0000","last_change":"2024-04-16T12:57:58.428239+0000","last_active":"2024-04-16T12:57:59.556745+0000","last_peered":"2024-04-16T12:57:59.556745+0000","last_clean":"2024-04-16T12:57:59.556745+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:57:59.556745+0000","last_undegraded":"2024-04-16T12:57:59.556745+0000","last_fullsized":"2024-04-16T12:57:59.556745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:18.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557492+0000","last_change":"2024-04-16T12:57:57.416742+0000","last_active":"2024-04-16T12:57:59.557492+0000","last_peered":"2024-04-16T12:57:59.557492+0000","last_clean":"2024-04-16T12:57:59.557492+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:57:59.557492+0000","last_undegraded":"2024-04-16T12:57:59.557492+0000","last_fullsized":"2024-04-16T12:57:59.557492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:28.073205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557717+0000","last_change":"2024-04-16T12:57:58.415256+0000","last_active":"2024-04-16T12:57:59.557717+0000","last_peered":"2024-04-16T12:57:59.557717+0000","last_clean":"2024-04-16T12:57:59.557717+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:57:59.557717+0000","last_undegraded":"2024-04-16T12:57:59.557717+0000","last_fullsized":"2024-04-16T12:57:59.557717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:44.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:57.418163+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556520+0000","last_change":"2024-04-16T12:57:58.422113+0000","last_active":"2024-04-16T12:57:59.556520+0000","last_peered":"2024-04-16T12:57:59.556520+0000","last_clean":"2024-04-16T12:57:59.556520+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:57:59.556520+0000","last_undegraded":"2024-04-16T12:57:59.556520+0000","last_fullsized":"2024-04-16T12:57:59.556520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:50.561113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557093+0000","last_change":"2024-04-16T12:57:57.420836+0000","last_active":"2024-04-16T12:57:59.557093+0000","last_peered":"2024-04-16T12:57:59.557093+0000","last_clean":"2024-04-16T12:57:59.557093+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:57:59.557093+0000","last_undegraded":"2024-04-16T12:57:59.557093+0000","last_fullsized":"2024-04-16T12:57:59.557093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409271+0000","last_change":"2024-04-16T12:57:58.418246+0000","last_active":"2024-04-16T12:57:59.409271+0000","last_peered":"2024-04-16T12:57:59.409271+0000","last_clean":"2024-04-16T12:57:59.409271+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:57:59.409271+0000","last_undegraded":"2024-04-16T12:57:59.409271+0000","last_fullsized":"2024-04-16T12:57:59.409271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408689+0000","last_change":"2024-04-16T12:57:57.415493+0000","last_active":"2024-04-16T12:57:59.408689+0000","last_peered":"2024-04-16T12:57:59.408689+0000","last_clean":"2024-04-16T12:57:59.408689+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:57:59.408689+0000","last_undegraded":"2024-04-16T12:57:59.408689+0000","last_fullsized":"2024-04-16T12:57:59.408689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557558+0000","last_change":"2024-04-16T12:57:58.424345+0000","last_active":"2024-04-16T12:57:59.557558+0000","last_peered":"2024-04-16T12:57:59.557558+0000","last_clean":"2024-04-16T12:57:59.557558+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:57:59.557558+0000","last_undegraded":"2024-04-16T12:57:59.557558+0000","last_fullsized":"2024-04-16T12:57:59.557558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:44.705042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410427+0000","last_change":"2024-04-16T12:57:57.419610+0000","last_active":"2024-04-16T12:57:59.410427+0000","last_peered":"2024-04-16T12:57:59.410427+0000","last_clean":"2024-04-16T12:57:59.410427+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:57:59.410427+0000","last_undegraded":"2024-04-16T12:57:59.410427+0000","last_fullsized":"2024-04-16T12:57:59.410427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:00:29.563675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409731+0000","last_change":"2024-04-16T12:57:58.428160+0000","last_active":"2024-04-16T12:57:59.409731+0000","last_peered":"2024-04-16T12:57:59.409731+0000","last_clean":"2024-04-16T12:57:59.409731+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:57:59.409731+0000","last_undegraded":"2024-04-16T12:57:59.409731+0000","last_fullsized":"2024-04-16T12:57:59.409731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557366+0000","last_change":"2024-04-16T12:57:57.415967+0000","last_active":"2024-04-16T12:57:59.557366+0000","last_peered":"2024-04-16T12:57:59.557366+0000","last_clean":"2024-04-16T12:57:59.557366+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:57:59.557366+0000","last_undegraded":"2024-04-16T12:57:59.557366+0000","last_fullsized":"2024-04-16T12:57:59.557366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556899+0000","last_change":"2024-04-16T12:57:58.419642+0000","last_active":"2024-04-16T12:57:59.556899+0000","last_peered":"2024-04-16T12:57:59.556899+0000","last_clean":"2024-04-16T12:57:59.556899+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:57:59.556899+0000","last_undegraded":"2024-04-16T12:57:59.556899+0000","last_fullsized":"2024-04-16T12:57:59.556899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410370+0000","last_change":"2024-04-16T12:57:57.416214+0000","last_active":"2024-04-16T12:57:59.410370+0000","last_peered":"2024-04-16T12:57:59.410370+0000","last_clean":"2024-04-16T12:57:59.410370+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:57:59.410370+0000","last_undegraded":"2024-04-16T12:57:59.410370+0000","last_fullsized":"2024-04-16T12:57:59.410370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557237+0000","last_change":"2024-04-16T12:57:58.420763+0000","last_active":"2024-04-16T12:57:59.557237+0000","last_peered":"2024-04-16T12:57:59.557237+0000","last_clean":"2024-04-16T12:57:59.557237+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:57:59.557237+0000","last_undegraded":"2024-04-16T12:57:59.557237+0000","last_fullsized":"2024-04-16T12:57:59.557237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557670+0000","last_change":"2024-04-16T12:57:57.413675+0000","last_active":"2024-04-16T12:57:59.557670+0000","last_peered":"2024-04-16T12:57:59.557670+0000","last_clean":"2024-04-16T12:57:59.557670+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:57:59.557670+0000","last_undegraded":"2024-04-16T12:57:59.557670+0000","last_fullsized":"2024-04-16T12:57:59.557670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557738+0000","last_change":"2024-04-16T12:57:58.417795+0000","last_active":"2024-04-16T12:57:59.557738+0000","last_peered":"2024-04-16T12:57:59.557738+0000","last_clean":"2024-04-16T12:57:59.557738+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:57:59.557738+0000","last_undegraded":"2024-04-16T12:57:59.557738+0000","last_fullsized":"2024-04-16T12:57:59.557738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410124+0000","last_change":"2024-04-16T12:57:57.418446+0000","last_active":"2024-04-16T12:57:59.410124+0000","last_peered":"2024-04-16T12:57:59.410124+0000","last_clean":"2024-04-16T12:57:59.410124+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:57:59.410124+0000","last_undegraded":"2024-04-16T12:57:59.410124+0000","last_fullsized":"2024-04-16T12:57:59.410124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556666+0000","last_change":"2024-04-16T12:57:58.415348+0000","last_active":"2024-04-16T12:57:59.556666+0000","last_peered":"2024-04-16T12:57:59.556666+0000","last_clean":"2024-04-16T12:57:59.556666+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:57:59.556666+0000","last_undegraded":"2024-04-16T12:57:59.556666+0000","last_fullsized":"2024-04-16T12:57:59.556666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557259+0000","last_change":"2024-04-16T12:57:57.424470+0000","last_active":"2024-04-16T12:57:59.557259+0000","last_peered":"2024-04-16T12:57:59.557259+0000","last_clean":"2024-04-16T12:57:59.557259+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:57:59.557259+0000","last_undegraded":"2024-04-16T12:57:59.557259+0000","last_fullsized":"2024-04-16T12:57:59.557259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:43.697285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556938+0000","last_change":"2024-04-16T12:57:58.428240+0000","last_active":"2024-04-16T12:57:59.556938+0000","last_peered":"2024-04-16T12:57:59.556938+0000","last_clean":"2024-04-16T12:57:59.556938+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:57:59.556938+0000","last_undegraded":"2024-04-16T12:57:59.556938+0000","last_fullsized":"2024-04-16T12:57:59.556938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556773+0000","last_change":"2024-04-16T12:57:57.416527+0000","last_active":"2024-04-16T12:57:59.556773+0000","last_peered":"2024-04-16T12:57:59.556773+0000","last_clean":"2024-04-16T12:57:59.556773+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:57:59.556773+0000","last_undegraded":"2024-04-16T12:57:59.556773+0000","last_fullsized":"2024-04-16T12:57:59.556773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408749+0000","last_change":"2024-04-16T12:57:58.422936+0000","last_active":"2024-04-16T12:57:59.408749+0000","last_peered":"2024-04-16T12:57:59.408749+0000","last_clean":"2024-04-16T12:57:59.408749+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:57:59.408749+0000","last_undegraded":"2024-04-16T12:57:59.408749+0000","last_fullsized":"2024-04-16T12:57:59.408749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556749+0000","last_change":"2024-04-16T12:57:57.418379+0000","last_active":"2024-04-16T12:57:59.556749+0000","last_peered":"2024-04-16T12:57:59.556749+0000","last_clean":"2024-04-16T12:57:59.556749+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:57:59.556749+0000","last_undegraded":"2024-04-16T12:57:59.556749+0000","last_fullsized":"2024-04-16T12:57:59.556749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409385+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:59.409385+0000","last_peered":"2024-04-16T12:57:59.409385+0000","last_clean":"2024-04-16T12:57:59.409385+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:59.409385+0000","last_undegraded":"2024-04-16T12:57:59.409385+0000","last_fullsized":"2024-04-16T12:57:59.409385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:02.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-16T12:58:02.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.604+0000 7f41a9455640 1 Processor -- start 2024-04-16T12:58:02.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.604+0000 7f41a9455640 1 -- start start 2024-04-16T12:58:02.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a9455640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f41a40b63a0 0x7f41a40b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a9455640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f41a41481c0 0x7f41a41418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a9455640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a4148b70 con 0x7f41a4148670 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a9455640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f41a40b4bd0 con 0x7f41a41481c0 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a9455640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f41a40b4eb0 con 0x7f41a40b63a0 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f419a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f41a41481c0 0x7f41a41418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a37fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f41a4148670 0x7f41a40b53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42962/0 (socket says 172.21.15.106:42962) 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a37fe640 1 -- 172.21.15.106:0/746737203 learned_addr learned my addr 172.21.15.106:0/746737203 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a2ffd640 1 --2- 172.21.15.106:0/746737203 >> v2:172.21.15.171:3300/0 conn(0x7f41a40b63a0 0x7f41a40b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f419a7fc640 1 -- 172.21.15.106:0/746737203 >> v2:172.21.15.171:3300/0 conn(0x7f41a40b63a0 msgr2=0x7f41a40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f419a7fc640 1 --2- 172.21.15.106:0/746737203 >> v2:172.21.15.171:3300/0 conn(0x7f41a40b63a0 0x7f41a40b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f419a7fc640 1 -- 172.21.15.106:0/746737203 >> v1:172.21.15.106:6789/0 conn(0x7f41a4148670 legacy=0x7f41a40b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f419a7fc640 1 -- 172.21.15.106:0/746737203 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a40b5ae0 con 0x7f41a41481c0 2024-04-16T12:58:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.605+0000 7f41a27fc640 1 -- 172.21.15.106:0/746737203 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516268424 0 0) 0x7f41a4148b70 con 0x7f41a4148670 2024-04-16T12:58:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.606+0000 7f419a7fc640 1 --2- 172.21.15.106:0/746737203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a41481c0 0x7f41a41418a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41a40b9e70 tx=0x7f418c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cf7c85e2b6631d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.606+0000 7f41a27fc640 1 -- 172.21.15.106:0/746737203 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c0315a0 con 0x7f41a41481c0 2024-04-16T12:58:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.606+0000 7f41a27fc640 1 -- 172.21.15.106:0/746737203 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c037070 con 0x7f41a41481c0 2024-04-16T12:58:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.606+0000 7f41a27fc640 1 -- 172.21.15.106:0/746737203 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c031960 con 0x7f41a41481c0 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 -- 172.21.15.106:0/746737203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a41481c0 msgr2=0x7f41a41418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 --2- 172.21.15.106:0/746737203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a41481c0 0x7f41a41418a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41a40b9e70 tx=0x7f418c02b840 comp rx=0 tx=0).stop 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 -- 172.21.15.106:0/746737203 shutdown_connections 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 --2- 172.21.15.106:0/746737203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a41481c0 0x7f41a41418a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 --2- 172.21.15.106:0/746737203 >> v2:172.21.15.171:3300/0 conn(0x7f41a40b63a0 0x7f41a40b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 -- 172.21.15.106:0/746737203 >> 172.21.15.106:0/746737203 conn(0x7f41a4068080 msgr2=0x7f41a40bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 -- 172.21.15.106:0/746737203 shutdown_connections 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.607+0000 7f41a9455640 1 -- 172.21.15.106:0/746737203 wait complete. 2024-04-16T12:58:02.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.608+0000 7f41a9455640 1 Processor -- start 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.608+0000 7f41a9455640 1 -- start start 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.608+0000 7f41a9455640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a40b63a0 0x7f41a414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a9455640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a41481c0 0x7f41a41dd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a9455640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a4148670 0x7f41a41ddb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a9455640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f41a41421b0 con 0x7f41a40b63a0 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a9455640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f41a4142030 con 0x7f41a4148670 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a9455640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41a4152610 con 0x7f41a41481c0 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a40b63a0 0x7f41a414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a40b63a0 0x7f41a414ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38764/0 (socket says 172.21.15.106:38764) 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 -- 172.21.15.106:0/765840537 learned_addr learned my addr 172.21.15.106:0/765840537 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a37fe640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a4148670 0x7f41a41ddb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f419a7fc640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a41481c0 0x7f41a41dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 -- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a41481c0 msgr2=0x7f41a41dd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a41481c0 0x7f41a41dd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 -- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a4148670 msgr2=0x7f41a41ddb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a4148670 0x7f41a41ddb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 -- 172.21.15.106:0/765840537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a4149950 con 0x7f41a40b63a0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a37fe640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a4148670 0x7f41a41ddb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a2ffd640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a40b63a0 0x7f41a414ab90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4194007ec0 tx=0x7f419400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f419bfff640 1 -- 172.21.15.106:0/765840537 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194014620 con 0x7f41a40b63a0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f419bfff640 1 -- 172.21.15.106:0/765840537 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4194019070 con 0x7f41a40b63a0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a414c330 con 0x7f41a40b63a0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f419bfff640 1 -- 172.21.15.106:0/765840537 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194014a20 con 0x7f41a40b63a0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.609+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a4149c00 con 0x7f41a40b63a0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.610+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a4068a90 con 0x7f41a40b63a0 2024-04-16T12:58:02.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.611+0000 7f419bfff640 1 -- 172.21.15.106:0/765840537 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4194014bc0 con 0x7f41a40b63a0 2024-04-16T12:58:02.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.611+0000 7f419bfff640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f418406c8f0 0x7f418406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.611+0000 7f419bfff640 1 -- 172.21.15.106:0/765840537 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f419408c440 con 0x7f41a40b63a0 2024-04-16T12:58:02.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.611+0000 7f419a7fc640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f418406c8f0 0x7f418406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.612+0000 7f419a7fc640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f418406c8f0 0x7f418406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f418c036000 tx=0x7f418c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.616+0000 7f419bfff640 1 -- 172.21.15.106:0/765840537 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f419405a900 con 0x7f41a40b63a0 2024-04-16T12:58:02.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-16T12:58:02.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.859+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f41a40bb3f0 con 0x7f41a40b63a0 2024-04-16T12:58:02.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.860+0000 7f419bfff640 1 -- 172.21.15.106:0/765840537 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2367 (secure 0 0 0) 0x7f419405a200 con 0x7f41a40b63a0 2024-04-16T12:58:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:02.862 INFO:teuthology.orchestra.run.smithi106.stdout:{"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":29,"num_osds":8,"num_up_osds":8,"osd_up_since":1713272225,"num_in_osds":8,"osd_in_since":1713272216,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":225222656,"bytes_avail":772868890624,"bytes_total":773094113280,"write_bytes_sec":2482,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4986}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-04-16T12:58:00.173114+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-16T12:58:02.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f418406c8f0 msgr2=0x7f418406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f418406c8f0 0x7f418406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f418c036000 tx=0x7f418c008030 comp rx=0 tx=0).stop 2024-04-16T12:58:02.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a40b63a0 msgr2=0x7f41a414ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a40b63a0 0x7f41a414ab90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4194007ec0 tx=0x7f419400e4b0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 shutdown_connections 2024-04-16T12:58:02.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f418406c8f0 0x7f418406edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a4148670 0x7f41a41ddb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a41481c0 0x7f41a41dd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 --2- 172.21.15.106:0/765840537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a40b63a0 0x7f41a414ab90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 >> 172.21.15.106:0/765840537 conn(0x7f41a4068080 msgr2=0x7f41a4146f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:02.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 shutdown_connections 2024-04-16T12:58:02.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.862+0000 7f41a9455640 1 -- 172.21.15.106:0/765840537 wait complete. 2024-04-16T12:58:02.874 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-16T12:58:02.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:02.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.975+0000 7fd6cf2e0640 1 Processor -- start 2024-04-16T12:58:02.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.975+0000 7fd6cf2e0640 1 -- start start 2024-04-16T12:58:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cf2e0640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6c80b63a0 0x7fd6c80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cf2e0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd6c8148670 0x7fd6c80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cf2e0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c8148b70 con 0x7fd6c81481c0 2024-04-16T12:58:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cf2e0640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c80b4bd0 con 0x7fd6c80b63a0 2024-04-16T12:58:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cf2e0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c80b4eb0 con 0x7fd6c8148670 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cd07c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6c80b63a0 0x7fd6c80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cc87b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd6c81481c0 0x7fd6c81418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42970/0 (socket says 172.21.15.106:42970) 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cc87b640 1 -- 172.21.15.106:0/2576355250 learned_addr learned my addr 172.21.15.106:0/2576355250 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cd07c640 1 -- 172.21.15.106:0/2576355250 >> v2:172.21.15.171:3300/0 conn(0x7fd6c8148670 msgr2=0x7fd6c80b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cd87d640 1 --2- 172.21.15.106:0/2576355250 >> v2:172.21.15.171:3300/0 conn(0x7fd6c8148670 0x7fd6c80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6bffff640 1 -- 172.21.15.106:0/2576355250 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496419497 0 0) 0x7fd6c8148b70 con 0x7fd6c81481c0 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cd07c640 1 --2- 172.21.15.106:0/2576355250 >> v2:172.21.15.171:3300/0 conn(0x7fd6c8148670 0x7fd6c80b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cd07c640 1 -- 172.21.15.106:0/2576355250 >> v1:172.21.15.106:6789/0 conn(0x7fd6c81481c0 legacy=0x7fd6c81418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cd07c640 1 -- 172.21.15.106:0/2576355250 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8141fb0 con 0x7fd6c80b63a0 2024-04-16T12:58:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.976+0000 7fd6cd87d640 1 --2- 172.21.15.106:0/2576355250 >> v2:172.21.15.171:3300/0 conn(0x7fd6c8148670 0x7fd6c80b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.977+0000 7fd6cd07c640 1 --2- 172.21.15.106:0/2576355250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c80b63a0 0x7fd6c80b6780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd6c808c200 tx=0x7fd6c402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce48055d7b93c99c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.977+0000 7fd6bffff640 1 -- 172.21.15.106:0/2576355250 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4039070 con 0x7fd6c80b63a0 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.977+0000 7fd6bffff640 1 -- 172.21.15.106:0/2576355250 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c402cbf0 con 0x7fd6c80b63a0 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.977+0000 7fd6bffff640 1 -- 172.21.15.106:0/2576355250 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4034440 con 0x7fd6c80b63a0 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/2576355250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c80b63a0 msgr2=0x7fd6c80b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/2576355250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c80b63a0 0x7fd6c80b6780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd6c808c200 tx=0x7fd6c402be40 comp rx=0 tx=0).stop 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/2576355250 shutdown_connections 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/2576355250 >> v2:172.21.15.171:3300/0 conn(0x7fd6c8148670 0x7fd6c80b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/2576355250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c80b63a0 0x7fd6c80b6780 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/2576355250 >> 172.21.15.106:0/2576355250 conn(0x7fd6c8068080 msgr2=0x7fd6c80bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/2576355250 shutdown_connections 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.978+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/2576355250 wait complete. 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.979+0000 7fd6cf2e0640 1 Processor -- start 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.979+0000 7fd6cf2e0640 1 -- start start 2024-04-16T12:58:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cf2e0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6c80b63a0 0x7fd6c814cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cf2e0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c81481c0 0x7fd6c8148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cf2e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6c8148670 0x7fd6c8149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cf2e0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c80b5ce0 con 0x7fd6c81481c0 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cf2e0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c80b5b60 con 0x7fd6c80b63a0 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cf2e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c8152610 con 0x7fd6c8148670 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c81481c0 0x7fd6c8148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c81481c0 0x7fd6c8148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38782/0 (socket says 172.21.15.106:38782) 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 -- 172.21.15.106:0/4025108541 learned_addr learned my addr 172.21.15.106:0/4025108541 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cd07c640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6c80b63a0 0x7fd6c814cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cd87d640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6c8148670 0x7fd6c8149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 -- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6c8148670 msgr2=0x7fd6c8149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6c8148670 0x7fd6c8149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 -- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6c80b63a0 msgr2=0x7fd6c814cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6c80b63a0 0x7fd6c814cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 -- 172.21.15.106:0/4025108541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c814e2c0 con 0x7fd6c81481c0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cd87d640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6c8148670 0x7fd6c8149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cc87b640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c81481c0 0x7fd6c8148e50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800c4d0 tx=0x7fd6b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6bdffb640 1 -- 172.21.15.106:0/4025108541 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8018070 con 0x7fd6c81481c0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6bdffb640 1 -- 172.21.15.106:0/4025108541 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b80074e0 con 0x7fd6c81481c0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c814bd50 con 0x7fd6c81481c0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.980+0000 7fd6bdffb640 1 -- 172.21.15.106:0/4025108541 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8004a20 con 0x7fd6c81481c0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.981+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c814c310 con 0x7fd6c81481c0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.982+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c8068a90 con 0x7fd6c81481c0 2024-04-16T12:58:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.982+0000 7fd6bdffb640 1 -- 172.21.15.106:0/4025108541 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6b801b070 con 0x7fd6c81481c0 2024-04-16T12:58:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.982+0000 7fd6bdffb640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd6ac06c8f0 0x7fd6ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.983+0000 7fd6bdffb640 1 -- 172.21.15.106:0/4025108541 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fd6b808ae10 con 0x7fd6c81481c0 2024-04-16T12:58:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.983+0000 7fd6cd07c640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd6ac06c8f0 0x7fd6ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.983+0000 7fd6cd07c640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd6ac06c8f0 0x7fd6ac06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4036000 tx=0x7fd6c4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:02.987+0000 7fd6bdffb640 1 -- 172.21.15.106:0/4025108541 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6b80592d0 con 0x7fd6c81481c0 2024-04-16T12:58:03.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.158+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6c814ab00 con 0x7fd6ac06c8f0 2024-04-16T12:58:03.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.164+0000 7fd6bdffb640 1 -- 172.21.15.106:0/4025108541 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fd6c814ab00 con 0x7fd6ac06c8f0 2024-04-16T12:58:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:03.170 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd6ac06c8f0 msgr2=0x7fd6ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd6ac06c8f0 0x7fd6ac06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4036000 tx=0x7fd6c4030000 comp rx=0 tx=0).stop 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c81481c0 msgr2=0x7fd6c8148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c81481c0 0x7fd6c8148e50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800c4d0 tx=0x7fd6b800c990 comp rx=0 tx=0).stop 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 shutdown_connections 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fd6ac06c8f0 0x7fd6ac06edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6c8148670 0x7fd6c8149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c81481c0 0x7fd6c8148e50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 --2- 172.21.15.106:0/4025108541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6c80b63a0 0x7fd6c814cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 >> 172.21.15.106:0/4025108541 conn(0x7fd6c8068080 msgr2=0x7fd6c8144570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 shutdown_connections 2024-04-16T12:58:03.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:03.167+0000 7fd6cf2e0640 1 -- 172.21.15.106:0/4025108541 wait complete. 2024-04-16T12:58:03.180 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-16T12:58:02.173349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.775509"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557061+0000","last_change":"2024-04-16T12:57:58.417066+0000","last_active":"2024-04-16T12:57:59.557061+0000","last_peered":"2024-04-16T12:57:59.557061+0000","last_clean":"2024-04-16T12:57:59.557061+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:57:59.557061+0000","last_undegraded":"2024-04-16T12:57:59.557061+0000","last_fullsized":"2024-04-16T12:57:59.557061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:40.783094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557293+0000","last_change":"2024-04-16T12:57:58.414223+0000","last_active":"2024-04-16T12:57:59.557293+0000","last_peered":"2024-04-16T12:57:59.557293+0000","last_clean":"2024-04-16T12:57:59.557293+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:57:59.557293+0000","last_undegraded":"2024-04-16T12:57:59.557293+0000","last_fullsized":"2024-04-16T12:57:59.557293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:04.064696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408863+0000","last_change":"2024-04-16T12:57:58.429706+0000","last_active":"2024-04-16T12:57:59.408863+0000","last_peered":"2024-04-16T12:57:59.408863+0000","last_clean":"2024-04-16T12:57:59.408863+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:57:59.408863+0000","last_undegraded":"2024-04-16T12:57:59.408863+0000","last_fullsized":"2024-04-16T12:57:59.408863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410150+0000","last_change":"2024-04-16T12:57:58.432119+0000","last_active":"2024-04-16T12:57:59.410150+0000","last_peered":"2024-04-16T12:57:59.410150+0000","last_clean":"2024-04-16T12:57:59.410150+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:57:59.410150+0000","last_undegraded":"2024-04-16T12:57:59.410150+0000","last_fullsized":"2024-04-16T12:57:59.410150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557573+0000","last_change":"2024-04-16T12:57:58.415012+0000","last_active":"2024-04-16T12:57:59.557573+0000","last_peered":"2024-04-16T12:57:59.557573+0000","last_clean":"2024-04-16T12:57:59.557573+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:57:59.557573+0000","last_undegraded":"2024-04-16T12:57:59.557573+0000","last_fullsized":"2024-04-16T12:57:59.557573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:02.447913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556831+0000","last_change":"2024-04-16T12:57:58.423617+0000","last_active":"2024-04-16T12:57:59.556831+0000","last_peered":"2024-04-16T12:57:59.556831+0000","last_clean":"2024-04-16T12:57:59.556831+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:57:59.556831+0000","last_undegraded":"2024-04-16T12:57:59.556831+0000","last_fullsized":"2024-04-16T12:57:59.556831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409523+0000","last_change":"2024-04-16T12:57:58.421176+0000","last_active":"2024-04-16T12:57:59.409523+0000","last_peered":"2024-04-16T12:57:59.409523+0000","last_clean":"2024-04-16T12:57:59.409523+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:57:59.409523+0000","last_undegraded":"2024-04-16T12:57:59.409523+0000","last_fullsized":"2024-04-16T12:57:59.409523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408717+0000","last_change":"2024-04-16T12:57:58.420336+0000","last_active":"2024-04-16T12:57:59.408717+0000","last_peered":"2024-04-16T12:57:59.408717+0000","last_clean":"2024-04-16T12:57:59.408717+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:57:59.408717+0000","last_undegraded":"2024-04-16T12:57:59.408717+0000","last_fullsized":"2024-04-16T12:57:59.408717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557536+0000","last_change":"2024-04-16T12:57:58.427221+0000","last_active":"2024-04-16T12:57:59.557536+0000","last_peered":"2024-04-16T12:57:59.557536+0000","last_clean":"2024-04-16T12:57:59.557536+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:57:59.557536+0000","last_undegraded":"2024-04-16T12:57:59.557536+0000","last_fullsized":"2024-04-16T12:57:59.557536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410349+0000","last_change":"2024-04-16T12:57:58.414532+0000","last_active":"2024-04-16T12:57:59.410349+0000","last_peered":"2024-04-16T12:57:59.410349+0000","last_clean":"2024-04-16T12:57:59.410349+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:57:59.410349+0000","last_undegraded":"2024-04-16T12:57:59.410349+0000","last_fullsized":"2024-04-16T12:57:59.410349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:33.604830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409656+0000","last_change":"2024-04-16T12:57:58.419590+0000","last_active":"2024-04-16T12:57:59.409656+0000","last_peered":"2024-04-16T12:57:59.409656+0000","last_clean":"2024-04-16T12:57:59.409656+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:57:59.409656+0000","last_undegraded":"2024-04-16T12:57:59.409656+0000","last_fullsized":"2024-04-16T12:57:59.409656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408763+0000","last_change":"2024-04-16T12:57:58.420968+0000","last_active":"2024-04-16T12:57:59.408763+0000","last_peered":"2024-04-16T12:57:59.408763+0000","last_clean":"2024-04-16T12:57:59.408763+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:57:59.408763+0000","last_undegraded":"2024-04-16T12:57:59.408763+0000","last_fullsized":"2024-04-16T12:57:59.408763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557659+0000","last_change":"2024-04-16T12:57:58.424597+0000","last_active":"2024-04-16T12:57:59.557659+0000","last_peered":"2024-04-16T12:57:59.557659+0000","last_clean":"2024-04-16T12:57:59.557659+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:57:59.557659+0000","last_undegraded":"2024-04-16T12:57:59.557659+0000","last_fullsized":"2024-04-16T12:57:59.557659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:58.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556986+0000","last_change":"2024-04-16T12:57:58.411816+0000","last_active":"2024-04-16T12:57:59.556986+0000","last_peered":"2024-04-16T12:57:59.556986+0000","last_clean":"2024-04-16T12:57:59.556986+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:57:59.556986+0000","last_undegraded":"2024-04-16T12:57:59.556986+0000","last_fullsized":"2024-04-16T12:57:59.556986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408901+0000","last_change":"2024-04-16T12:57:58.419271+0000","last_active":"2024-04-16T12:57:59.408901+0000","last_peered":"2024-04-16T12:57:59.408901+0000","last_clean":"2024-04-16T12:57:59.408901+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:57:59.408901+0000","last_undegraded":"2024-04-16T12:57:59.408901+0000","last_fullsized":"2024-04-16T12:57:59.408901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409323+0000","last_change":"2024-04-16T12:57:58.421606+0000","last_active":"2024-04-16T12:57:59.409323+0000","last_peered":"2024-04-16T12:57:59.409323+0000","last_clean":"2024-04-16T12:57:59.409323+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:57:59.409323+0000","last_undegraded":"2024-04-16T12:57:59.409323+0000","last_fullsized":"2024-04-16T12:57:59.409323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409307+0000","last_change":"2024-04-16T12:57:58.421726+0000","last_active":"2024-04-16T12:57:59.409307+0000","last_peered":"2024-04-16T12:57:59.409307+0000","last_clean":"2024-04-16T12:57:59.409307+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:57:59.409307+0000","last_undegraded":"2024-04-16T12:57:59.409307+0000","last_fullsized":"2024-04-16T12:57:59.409307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557302+0000","last_change":"2024-04-16T12:57:58.417403+0000","last_active":"2024-04-16T12:57:59.557302+0000","last_peered":"2024-04-16T12:57:59.557302+0000","last_clean":"2024-04-16T12:57:59.557302+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:57:59.557302+0000","last_undegraded":"2024-04-16T12:57:59.557302+0000","last_fullsized":"2024-04-16T12:57:59.557302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:24.189968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556932+0000","last_change":"2024-04-16T12:57:58.423377+0000","last_active":"2024-04-16T12:57:59.556932+0000","last_peered":"2024-04-16T12:57:59.556932+0000","last_clean":"2024-04-16T12:57:59.556932+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:57:59.556932+0000","last_undegraded":"2024-04-16T12:57:59.556932+0000","last_fullsized":"2024-04-16T12:57:59.556932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557686+0000","last_change":"2024-04-16T12:57:58.422790+0000","last_active":"2024-04-16T12:57:59.557686+0000","last_peered":"2024-04-16T12:57:59.557686+0000","last_clean":"2024-04-16T12:57:59.557686+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:57:59.557686+0000","last_undegraded":"2024-04-16T12:57:59.557686+0000","last_fullsized":"2024-04-16T12:57:59.557686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:04.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557897+0000","last_change":"2024-04-16T12:57:58.432630+0000","last_active":"2024-04-16T12:57:59.557897+0000","last_peered":"2024-04-16T12:57:59.557897+0000","last_clean":"2024-04-16T12:57:59.557897+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:57:59.557897+0000","last_undegraded":"2024-04-16T12:57:59.557897+0000","last_fullsized":"2024-04-16T12:57:59.557897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557157+0000","last_change":"2024-04-16T12:57:58.428165+0000","last_active":"2024-04-16T12:57:59.557157+0000","last_peered":"2024-04-16T12:57:59.557157+0000","last_clean":"2024-04-16T12:57:59.557157+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:57:59.557157+0000","last_undegraded":"2024-04-16T12:57:59.557157+0000","last_fullsized":"2024-04-16T12:57:59.557157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556657+0000","last_change":"2024-04-16T12:57:58.419322+0000","last_active":"2024-04-16T12:57:59.556657+0000","last_peered":"2024-04-16T12:57:59.556657+0000","last_clean":"2024-04-16T12:57:59.556657+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:57:59.556657+0000","last_undegraded":"2024-04-16T12:57:59.556657+0000","last_fullsized":"2024-04-16T12:57:59.556657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408594+0000","last_change":"2024-04-16T12:57:58.425245+0000","last_active":"2024-04-16T12:57:59.408594+0000","last_peered":"2024-04-16T12:57:59.408594+0000","last_clean":"2024-04-16T12:57:59.408594+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:57:59.408594+0000","last_undegraded":"2024-04-16T12:57:59.408594+0000","last_fullsized":"2024-04-16T12:57:59.408594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410326+0000","last_change":"2024-04-16T12:57:58.422256+0000","last_active":"2024-04-16T12:57:59.410326+0000","last_peered":"2024-04-16T12:57:59.410326+0000","last_clean":"2024-04-16T12:57:59.410326+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:57:59.410326+0000","last_undegraded":"2024-04-16T12:57:59.410326+0000","last_fullsized":"2024-04-16T12:57:59.410326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557449+0000","last_change":"2024-04-16T12:57:58.421697+0000","last_active":"2024-04-16T12:57:59.557449+0000","last_peered":"2024-04-16T12:57:59.557449+0000","last_clean":"2024-04-16T12:57:59.557449+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:57:59.557449+0000","last_undegraded":"2024-04-16T12:57:59.557449+0000","last_fullsized":"2024-04-16T12:57:59.557449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:39.008329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410430+0000","last_change":"2024-04-16T12:57:58.429064+0000","last_active":"2024-04-16T12:57:59.410430+0000","last_peered":"2024-04-16T12:57:59.410430+0000","last_clean":"2024-04-16T12:57:59.410430+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:57:59.410430+0000","last_undegraded":"2024-04-16T12:57:59.410430+0000","last_fullsized":"2024-04-16T12:57:59.410430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408814+0000","last_change":"2024-04-16T12:57:58.420144+0000","last_active":"2024-04-16T12:57:59.408814+0000","last_peered":"2024-04-16T12:57:59.408814+0000","last_clean":"2024-04-16T12:57:59.408814+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:57:59.408814+0000","last_undegraded":"2024-04-16T12:57:59.408814+0000","last_fullsized":"2024-04-16T12:57:59.408814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557851+0000","last_change":"2024-04-16T12:57:58.428551+0000","last_active":"2024-04-16T12:57:59.557851+0000","last_peered":"2024-04-16T12:57:59.557851+0000","last_clean":"2024-04-16T12:57:59.557851+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:57:59.557851+0000","last_undegraded":"2024-04-16T12:57:59.557851+0000","last_fullsized":"2024-04-16T12:57:59.557851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408962+0000","last_change":"2024-04-16T12:57:58.419164+0000","last_active":"2024-04-16T12:57:59.408962+0000","last_peered":"2024-04-16T12:57:59.408962+0000","last_clean":"2024-04-16T12:57:59.408962+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:57:59.408962+0000","last_undegraded":"2024-04-16T12:57:59.408962+0000","last_fullsized":"2024-04-16T12:57:59.408962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557022+0000","last_change":"2024-04-16T12:57:58.417480+0000","last_active":"2024-04-16T12:57:59.557022+0000","last_peered":"2024-04-16T12:57:59.557022+0000","last_clean":"2024-04-16T12:57:59.557022+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:57:59.557022+0000","last_undegraded":"2024-04-16T12:57:59.557022+0000","last_fullsized":"2024-04-16T12:57:59.557022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:55:29.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408880+0000","last_change":"2024-04-16T12:57:58.429121+0000","last_active":"2024-04-16T12:57:59.408880+0000","last_peered":"2024-04-16T12:57:59.408880+0000","last_clean":"2024-04-16T12:57:59.408880+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:57:59.408880+0000","last_undegraded":"2024-04-16T12:57:59.408880+0000","last_fullsized":"2024-04-16T12:57:59.408880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.529728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557103+0000","last_change":"2024-04-16T12:57:58.425769+0000","last_active":"2024-04-16T12:57:59.557103+0000","last_peered":"2024-04-16T12:57:59.557103+0000","last_clean":"2024-04-16T12:57:59.557103+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:57:59.557103+0000","last_undegraded":"2024-04-16T12:57:59.557103+0000","last_fullsized":"2024-04-16T12:57:59.557103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557168+0000","last_change":"2024-04-16T12:57:57.419875+0000","last_active":"2024-04-16T12:57:59.557168+0000","last_peered":"2024-04-16T12:57:59.557168+0000","last_clean":"2024-04-16T12:57:59.557168+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:57:59.557168+0000","last_undegraded":"2024-04-16T12:57:59.557168+0000","last_fullsized":"2024-04-16T12:57:59.557168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556949+0000","last_change":"2024-04-16T12:57:58.429507+0000","last_active":"2024-04-16T12:57:59.556949+0000","last_peered":"2024-04-16T12:57:59.556949+0000","last_clean":"2024-04-16T12:57:59.556949+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:57:59.556949+0000","last_undegraded":"2024-04-16T12:57:59.556949+0000","last_fullsized":"2024-04-16T12:57:59.556949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:48.320225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557195+0000","last_change":"2024-04-16T12:57:57.409560+0000","last_active":"2024-04-16T12:57:59.557195+0000","last_peered":"2024-04-16T12:57:59.557195+0000","last_clean":"2024-04-16T12:57:59.557195+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:57:59.557195+0000","last_undegraded":"2024-04-16T12:57:59.557195+0000","last_fullsized":"2024-04-16T12:57:59.557195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557564+0000","last_change":"2024-04-16T12:57:58.430344+0000","last_active":"2024-04-16T12:57:59.557564+0000","last_peered":"2024-04-16T12:57:59.557564+0000","last_clean":"2024-04-16T12:57:59.557564+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:57:59.557564+0000","last_undegraded":"2024-04-16T12:57:59.557564+0000","last_fullsized":"2024-04-16T12:57:59.557564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557003+0000","last_change":"2024-04-16T12:57:57.421388+0000","last_active":"2024-04-16T12:57:59.557003+0000","last_peered":"2024-04-16T12:57:59.557003+0000","last_clean":"2024-04-16T12:57:59.557003+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:57:59.557003+0000","last_undegraded":"2024-04-16T12:57:59.557003+0000","last_fullsized":"2024-04-16T12:57:59.557003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:23.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410459+0000","last_change":"2024-04-16T12:57:58.427164+0000","last_active":"2024-04-16T12:57:59.410459+0000","last_peered":"2024-04-16T12:57:59.410459+0000","last_clean":"2024-04-16T12:57:59.410459+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:57:59.410459+0000","last_undegraded":"2024-04-16T12:57:59.410459+0000","last_fullsized":"2024-04-16T12:57:59.410459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557793+0000","last_change":"2024-04-16T12:57:57.419891+0000","last_active":"2024-04-16T12:57:59.557793+0000","last_peered":"2024-04-16T12:57:59.557793+0000","last_clean":"2024-04-16T12:57:59.557793+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:57:59.557793+0000","last_undegraded":"2024-04-16T12:57:59.557793+0000","last_fullsized":"2024-04-16T12:57:59.557793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:48.386771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409438+0000","last_change":"2024-04-16T12:57:58.428187+0000","last_active":"2024-04-16T12:57:59.409438+0000","last_peered":"2024-04-16T12:57:59.409438+0000","last_clean":"2024-04-16T12:57:59.409438+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:57:59.409438+0000","last_undegraded":"2024-04-16T12:57:59.409438+0000","last_fullsized":"2024-04-16T12:57:59.409438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557927+0000","last_change":"2024-04-16T12:57:57.419136+0000","last_active":"2024-04-16T12:57:59.557927+0000","last_peered":"2024-04-16T12:57:59.557927+0000","last_clean":"2024-04-16T12:57:59.557927+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:57:59.557927+0000","last_undegraded":"2024-04-16T12:57:59.557927+0000","last_fullsized":"2024-04-16T12:57:59.557927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408786+0000","last_change":"2024-04-16T12:57:58.428624+0000","last_active":"2024-04-16T12:57:59.408786+0000","last_peered":"2024-04-16T12:57:59.408786+0000","last_clean":"2024-04-16T12:57:59.408786+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:57:59.408786+0000","last_undegraded":"2024-04-16T12:57:59.408786+0000","last_fullsized":"2024-04-16T12:57:59.408786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557287+0000","last_change":"2024-04-16T12:57:57.418607+0000","last_active":"2024-04-16T12:57:59.557287+0000","last_peered":"2024-04-16T12:57:59.557287+0000","last_clean":"2024-04-16T12:57:59.557287+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:57:59.557287+0000","last_undegraded":"2024-04-16T12:57:59.557287+0000","last_fullsized":"2024-04-16T12:57:59.557287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:17.248246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556971+0000","last_change":"2024-04-16T12:57:58.426553+0000","last_active":"2024-04-16T12:57:59.556971+0000","last_peered":"2024-04-16T12:57:59.556971+0000","last_clean":"2024-04-16T12:57:59.556971+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:57:59.556971+0000","last_undegraded":"2024-04-16T12:57:59.556971+0000","last_fullsized":"2024-04-16T12:57:59.556971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556800+0000","last_change":"2024-04-16T12:57:57.418496+0000","last_active":"2024-04-16T12:57:59.556800+0000","last_peered":"2024-04-16T12:57:59.556800+0000","last_clean":"2024-04-16T12:57:59.556800+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:57:59.556800+0000","last_undegraded":"2024-04-16T12:57:59.556800+0000","last_fullsized":"2024-04-16T12:57:59.556800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409997+0000","last_change":"2024-04-16T12:57:58.421803+0000","last_active":"2024-04-16T12:57:59.409997+0000","last_peered":"2024-04-16T12:57:59.409997+0000","last_clean":"2024-04-16T12:57:59.409997+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:57:59.409997+0000","last_undegraded":"2024-04-16T12:57:59.409997+0000","last_fullsized":"2024-04-16T12:57:59.409997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557158+0000","last_change":"2024-04-16T12:57:57.417993+0000","last_active":"2024-04-16T12:57:59.557158+0000","last_peered":"2024-04-16T12:57:59.557158+0000","last_clean":"2024-04-16T12:57:59.557158+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:57:59.557158+0000","last_undegraded":"2024-04-16T12:57:59.557158+0000","last_fullsized":"2024-04-16T12:57:59.557158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:27:27.583239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409611+0000","last_change":"2024-04-16T12:57:58.421729+0000","last_active":"2024-04-16T12:57:59.409611+0000","last_peered":"2024-04-16T12:57:59.409611+0000","last_clean":"2024-04-16T12:57:59.409611+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:57:59.409611+0000","last_undegraded":"2024-04-16T12:57:59.409611+0000","last_fullsized":"2024-04-16T12:57:59.409611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556740+0000","last_change":"2024-04-16T12:57:57.419936+0000","last_active":"2024-04-16T12:57:59.556740+0000","last_peered":"2024-04-16T12:57:59.556740+0000","last_clean":"2024-04-16T12:57:59.556740+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:57:59.556740+0000","last_undegraded":"2024-04-16T12:57:59.556740+0000","last_fullsized":"2024-04-16T12:57:59.556740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:09.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556761+0000","last_change":"2024-04-16T12:57:58.423776+0000","last_active":"2024-04-16T12:57:59.556761+0000","last_peered":"2024-04-16T12:57:59.556761+0000","last_clean":"2024-04-16T12:57:59.556761+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:57:59.556761+0000","last_undegraded":"2024-04-16T12:57:59.556761+0000","last_fullsized":"2024-04-16T12:57:59.556761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557282+0000","last_change":"2024-04-16T12:57:57.418768+0000","last_active":"2024-04-16T12:57:59.557282+0000","last_peered":"2024-04-16T12:57:59.557282+0000","last_clean":"2024-04-16T12:57:59.557282+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:57:59.557282+0000","last_undegraded":"2024-04-16T12:57:59.557282+0000","last_fullsized":"2024-04-16T12:57:59.557282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557137+0000","last_change":"2024-04-16T12:57:58.421105+0000","last_active":"2024-04-16T12:57:59.557137+0000","last_peered":"2024-04-16T12:57:59.557137+0000","last_clean":"2024-04-16T12:57:59.557137+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:57:59.557137+0000","last_undegraded":"2024-04-16T12:57:59.557137+0000","last_fullsized":"2024-04-16T12:57:59.557137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408991+0000","last_change":"2024-04-16T12:57:57.416238+0000","last_active":"2024-04-16T12:57:59.408991+0000","last_peered":"2024-04-16T12:57:59.408991+0000","last_clean":"2024-04-16T12:57:59.408991+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:57:59.408991+0000","last_undegraded":"2024-04-16T12:57:59.408991+0000","last_fullsized":"2024-04-16T12:57:59.408991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408608+0000","last_change":"2024-04-16T12:57:58.428014+0000","last_active":"2024-04-16T12:57:59.408608+0000","last_peered":"2024-04-16T12:57:59.408608+0000","last_clean":"2024-04-16T12:57:59.408608+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:57:59.408608+0000","last_undegraded":"2024-04-16T12:57:59.408608+0000","last_fullsized":"2024-04-16T12:57:59.408608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557150+0000","last_change":"2024-04-16T12:57:57.421382+0000","last_active":"2024-04-16T12:57:59.557150+0000","last_peered":"2024-04-16T12:57:59.557150+0000","last_clean":"2024-04-16T12:57:59.557150+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:57:59.557150+0000","last_undegraded":"2024-04-16T12:57:59.557150+0000","last_fullsized":"2024-04-16T12:57:59.557150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:09.260220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410034+0000","last_change":"2024-04-16T12:57:58.417617+0000","last_active":"2024-04-16T12:57:59.410034+0000","last_peered":"2024-04-16T12:57:59.410034+0000","last_clean":"2024-04-16T12:57:59.410034+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:57:59.410034+0000","last_undegraded":"2024-04-16T12:57:59.410034+0000","last_fullsized":"2024-04-16T12:57:59.410034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.558015+0000","last_change":"2024-04-16T12:57:57.419094+0000","last_active":"2024-04-16T12:57:59.558015+0000","last_peered":"2024-04-16T12:57:59.558015+0000","last_clean":"2024-04-16T12:57:59.558015+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:57:59.558015+0000","last_undegraded":"2024-04-16T12:57:59.558015+0000","last_fullsized":"2024-04-16T12:57:59.558015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557010+0000","last_change":"2024-04-16T12:57:58.414688+0000","last_active":"2024-04-16T12:57:59.557010+0000","last_peered":"2024-04-16T12:57:59.557010+0000","last_clean":"2024-04-16T12:57:59.557010+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:57:59.557010+0000","last_undegraded":"2024-04-16T12:57:59.557010+0000","last_fullsized":"2024-04-16T12:57:59.557010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410019+0000","last_change":"2024-04-16T12:57:57.416542+0000","last_active":"2024-04-16T12:57:59.410019+0000","last_peered":"2024-04-16T12:57:59.410019+0000","last_clean":"2024-04-16T12:57:59.410019+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:57:59.410019+0000","last_undegraded":"2024-04-16T12:57:59.410019+0000","last_fullsized":"2024-04-16T12:57:59.410019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409146+0000","last_change":"2024-04-16T12:57:58.429363+0000","last_active":"2024-04-16T12:57:59.409146+0000","last_peered":"2024-04-16T12:57:59.409146+0000","last_clean":"2024-04-16T12:57:59.409146+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:57:59.409146+0000","last_undegraded":"2024-04-16T12:57:59.409146+0000","last_fullsized":"2024-04-16T12:57:59.409146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557034+0000","last_change":"2024-04-16T12:57:57.417272+0000","last_active":"2024-04-16T12:57:59.557034+0000","last_peered":"2024-04-16T12:57:59.557034+0000","last_clean":"2024-04-16T12:57:59.557034+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:57:59.557034+0000","last_undegraded":"2024-04-16T12:57:59.557034+0000","last_fullsized":"2024-04-16T12:57:59.557034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:19.085142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:58.428318+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556658+0000","last_change":"2024-04-16T12:57:57.418665+0000","last_active":"2024-04-16T12:57:59.556658+0000","last_peered":"2024-04-16T12:57:59.556658+0000","last_clean":"2024-04-16T12:57:59.556658+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:57:59.556658+0000","last_undegraded":"2024-04-16T12:57:59.556658+0000","last_fullsized":"2024-04-16T12:57:59.556658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:39.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557740+0000","last_change":"2024-04-16T12:57:58.424884+0000","last_active":"2024-04-16T12:57:59.557740+0000","last_peered":"2024-04-16T12:57:59.557740+0000","last_clean":"2024-04-16T12:57:59.557740+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:57:59.557740+0000","last_undegraded":"2024-04-16T12:57:59.557740+0000","last_fullsized":"2024-04-16T12:57:59.557740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410365+0000","last_change":"2024-04-16T12:57:57.417511+0000","last_active":"2024-04-16T12:57:59.410365+0000","last_peered":"2024-04-16T12:57:59.410365+0000","last_clean":"2024-04-16T12:57:59.410365+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:57:59.410365+0000","last_undegraded":"2024-04-16T12:57:59.410365+0000","last_fullsized":"2024-04-16T12:57:59.410365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409706+0000","last_change":"2024-04-16T12:57:58.431315+0000","last_active":"2024-04-16T12:57:59.409706+0000","last_peered":"2024-04-16T12:57:59.409706+0000","last_clean":"2024-04-16T12:57:59.409706+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:57:59.409706+0000","last_undegraded":"2024-04-16T12:57:59.409706+0000","last_fullsized":"2024-04-16T12:57:59.409706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557710+0000","last_change":"2024-04-16T12:57:57.419368+0000","last_active":"2024-04-16T12:57:59.557710+0000","last_peered":"2024-04-16T12:57:59.557710+0000","last_clean":"2024-04-16T12:57:59.557710+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:57:59.557710+0000","last_undegraded":"2024-04-16T12:57:59.557710+0000","last_fullsized":"2024-04-16T12:57:59.557710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410299+0000","last_change":"2024-04-16T12:57:58.431490+0000","last_active":"2024-04-16T12:57:59.410299+0000","last_peered":"2024-04-16T12:57:59.410299+0000","last_clean":"2024-04-16T12:57:59.410299+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:57:59.410299+0000","last_undegraded":"2024-04-16T12:57:59.410299+0000","last_fullsized":"2024-04-16T12:57:59.410299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557329+0000","last_change":"2024-04-16T12:57:57.418637+0000","last_active":"2024-04-16T12:57:59.557329+0000","last_peered":"2024-04-16T12:57:59.557329+0000","last_clean":"2024-04-16T12:57:59.557329+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:57:59.557329+0000","last_undegraded":"2024-04-16T12:57:59.557329+0000","last_fullsized":"2024-04-16T12:57:59.557329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:49.553356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557676+0000","last_change":"2024-04-16T12:57:58.420291+0000","last_active":"2024-04-16T12:57:59.557676+0000","last_peered":"2024-04-16T12:57:59.557676+0000","last_clean":"2024-04-16T12:57:59.557676+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:57:59.557676+0000","last_undegraded":"2024-04-16T12:57:59.557676+0000","last_fullsized":"2024-04-16T12:57:59.557676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557561+0000","last_change":"2024-04-16T12:57:57.420173+0000","last_active":"2024-04-16T12:57:59.557561+0000","last_peered":"2024-04-16T12:57:59.557561+0000","last_clean":"2024-04-16T12:57:59.557561+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:57:59.557561+0000","last_undegraded":"2024-04-16T12:57:59.557561+0000","last_fullsized":"2024-04-16T12:57:59.557561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:01.440156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556745+0000","last_change":"2024-04-16T12:57:58.428239+0000","last_active":"2024-04-16T12:57:59.556745+0000","last_peered":"2024-04-16T12:57:59.556745+0000","last_clean":"2024-04-16T12:57:59.556745+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:57:59.556745+0000","last_undegraded":"2024-04-16T12:57:59.556745+0000","last_fullsized":"2024-04-16T12:57:59.556745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:18.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557492+0000","last_change":"2024-04-16T12:57:57.416742+0000","last_active":"2024-04-16T12:57:59.557492+0000","last_peered":"2024-04-16T12:57:59.557492+0000","last_clean":"2024-04-16T12:57:59.557492+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:57:59.557492+0000","last_undegraded":"2024-04-16T12:57:59.557492+0000","last_fullsized":"2024-04-16T12:57:59.557492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:28.073205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557717+0000","last_change":"2024-04-16T12:57:58.415256+0000","last_active":"2024-04-16T12:57:59.557717+0000","last_peered":"2024-04-16T12:57:59.557717+0000","last_clean":"2024-04-16T12:57:59.557717+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:57:59.557717+0000","last_undegraded":"2024-04-16T12:57:59.557717+0000","last_fullsized":"2024-04-16T12:57:59.557717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:44.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:57.418163+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556520+0000","last_change":"2024-04-16T12:57:58.422113+0000","last_active":"2024-04-16T12:57:59.556520+0000","last_peered":"2024-04-16T12:57:59.556520+0000","last_clean":"2024-04-16T12:57:59.556520+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:57:59.556520+0000","last_undegraded":"2024-04-16T12:57:59.556520+0000","last_fullsized":"2024-04-16T12:57:59.556520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:50.561113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557093+0000","last_change":"2024-04-16T12:57:57.420836+0000","last_active":"2024-04-16T12:57:59.557093+0000","last_peered":"2024-04-16T12:57:59.557093+0000","last_clean":"2024-04-16T12:57:59.557093+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:57:59.557093+0000","last_undegraded":"2024-04-16T12:57:59.557093+0000","last_fullsized":"2024-04-16T12:57:59.557093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409271+0000","last_change":"2024-04-16T12:57:58.418246+0000","last_active":"2024-04-16T12:57:59.409271+0000","last_peered":"2024-04-16T12:57:59.409271+0000","last_clean":"2024-04-16T12:57:59.409271+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:57:59.409271+0000","last_undegraded":"2024-04-16T12:57:59.409271+0000","last_fullsized":"2024-04-16T12:57:59.409271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408689+0000","last_change":"2024-04-16T12:57:57.415493+0000","last_active":"2024-04-16T12:57:59.408689+0000","last_peered":"2024-04-16T12:57:59.408689+0000","last_clean":"2024-04-16T12:57:59.408689+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:57:59.408689+0000","last_undegraded":"2024-04-16T12:57:59.408689+0000","last_fullsized":"2024-04-16T12:57:59.408689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557558+0000","last_change":"2024-04-16T12:57:58.424345+0000","last_active":"2024-04-16T12:57:59.557558+0000","last_peered":"2024-04-16T12:57:59.557558+0000","last_clean":"2024-04-16T12:57:59.557558+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:57:59.557558+0000","last_undegraded":"2024-04-16T12:57:59.557558+0000","last_fullsized":"2024-04-16T12:57:59.557558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:44.705042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410427+0000","last_change":"2024-04-16T12:57:57.419610+0000","last_active":"2024-04-16T12:57:59.410427+0000","last_peered":"2024-04-16T12:57:59.410427+0000","last_clean":"2024-04-16T12:57:59.410427+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:57:59.410427+0000","last_undegraded":"2024-04-16T12:57:59.410427+0000","last_fullsized":"2024-04-16T12:57:59.410427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:00:29.563675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409731+0000","last_change":"2024-04-16T12:57:58.428160+0000","last_active":"2024-04-16T12:57:59.409731+0000","last_peered":"2024-04-16T12:57:59.409731+0000","last_clean":"2024-04-16T12:57:59.409731+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:57:59.409731+0000","last_undegraded":"2024-04-16T12:57:59.409731+0000","last_fullsized":"2024-04-16T12:57:59.409731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557366+0000","last_change":"2024-04-16T12:57:57.415967+0000","last_active":"2024-04-16T12:57:59.557366+0000","last_peered":"2024-04-16T12:57:59.557366+0000","last_clean":"2024-04-16T12:57:59.557366+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:57:59.557366+0000","last_undegraded":"2024-04-16T12:57:59.557366+0000","last_fullsized":"2024-04-16T12:57:59.557366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556899+0000","last_change":"2024-04-16T12:57:58.419642+0000","last_active":"2024-04-16T12:57:59.556899+0000","last_peered":"2024-04-16T12:57:59.556899+0000","last_clean":"2024-04-16T12:57:59.556899+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:57:59.556899+0000","last_undegraded":"2024-04-16T12:57:59.556899+0000","last_fullsized":"2024-04-16T12:57:59.556899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410370+0000","last_change":"2024-04-16T12:57:57.416214+0000","last_active":"2024-04-16T12:57:59.410370+0000","last_peered":"2024-04-16T12:57:59.410370+0000","last_clean":"2024-04-16T12:57:59.410370+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:57:59.410370+0000","last_undegraded":"2024-04-16T12:57:59.410370+0000","last_fullsized":"2024-04-16T12:57:59.410370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557237+0000","last_change":"2024-04-16T12:57:58.420763+0000","last_active":"2024-04-16T12:57:59.557237+0000","last_peered":"2024-04-16T12:57:59.557237+0000","last_clean":"2024-04-16T12:57:59.557237+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:57:59.557237+0000","last_undegraded":"2024-04-16T12:57:59.557237+0000","last_fullsized":"2024-04-16T12:57:59.557237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557670+0000","last_change":"2024-04-16T12:57:57.413675+0000","last_active":"2024-04-16T12:57:59.557670+0000","last_peered":"2024-04-16T12:57:59.557670+0000","last_clean":"2024-04-16T12:57:59.557670+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:57:59.557670+0000","last_undegraded":"2024-04-16T12:57:59.557670+0000","last_fullsized":"2024-04-16T12:57:59.557670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557738+0000","last_change":"2024-04-16T12:57:58.417795+0000","last_active":"2024-04-16T12:57:59.557738+0000","last_peered":"2024-04-16T12:57:59.557738+0000","last_clean":"2024-04-16T12:57:59.557738+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:57:59.557738+0000","last_undegraded":"2024-04-16T12:57:59.557738+0000","last_fullsized":"2024-04-16T12:57:59.557738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410124+0000","last_change":"2024-04-16T12:57:57.418446+0000","last_active":"2024-04-16T12:57:59.410124+0000","last_peered":"2024-04-16T12:57:59.410124+0000","last_clean":"2024-04-16T12:57:59.410124+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:57:59.410124+0000","last_undegraded":"2024-04-16T12:57:59.410124+0000","last_fullsized":"2024-04-16T12:57:59.410124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556666+0000","last_change":"2024-04-16T12:57:58.415348+0000","last_active":"2024-04-16T12:57:59.556666+0000","last_peered":"2024-04-16T12:57:59.556666+0000","last_clean":"2024-04-16T12:57:59.556666+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:57:59.556666+0000","last_undegraded":"2024-04-16T12:57:59.556666+0000","last_fullsized":"2024-04-16T12:57:59.556666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557259+0000","last_change":"2024-04-16T12:57:57.424470+0000","last_active":"2024-04-16T12:57:59.557259+0000","last_peered":"2024-04-16T12:57:59.557259+0000","last_clean":"2024-04-16T12:57:59.557259+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:57:59.557259+0000","last_undegraded":"2024-04-16T12:57:59.557259+0000","last_fullsized":"2024-04-16T12:57:59.557259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:43.697285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556938+0000","last_change":"2024-04-16T12:57:58.428240+0000","last_active":"2024-04-16T12:57:59.556938+0000","last_peered":"2024-04-16T12:57:59.556938+0000","last_clean":"2024-04-16T12:57:59.556938+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:57:59.556938+0000","last_undegraded":"2024-04-16T12:57:59.556938+0000","last_fullsized":"2024-04-16T12:57:59.556938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556773+0000","last_change":"2024-04-16T12:57:57.416527+0000","last_active":"2024-04-16T12:57:59.556773+0000","last_peered":"2024-04-16T12:57:59.556773+0000","last_clean":"2024-04-16T12:57:59.556773+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:57:59.556773+0000","last_undegraded":"2024-04-16T12:57:59.556773+0000","last_fullsized":"2024-04-16T12:57:59.556773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408749+0000","last_change":"2024-04-16T12:57:58.422936+0000","last_active":"2024-04-16T12:57:59.408749+0000","last_peered":"2024-04-16T12:57:59.408749+0000","last_clean":"2024-04-16T12:57:59.408749+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:57:59.408749+0000","last_undegraded":"2024-04-16T12:57:59.408749+0000","last_fullsized":"2024-04-16T12:57:59.408749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556749+0000","last_change":"2024-04-16T12:57:57.418379+0000","last_active":"2024-04-16T12:57:59.556749+0000","last_peered":"2024-04-16T12:57:59.556749+0000","last_clean":"2024-04-16T12:57:59.556749+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:57:59.556749+0000","last_undegraded":"2024-04-16T12:57:59.556749+0000","last_fullsized":"2024-04-16T12:57:59.556749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409385+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:59.409385+0000","last_peered":"2024-04-16T12:57:59.409385+0000","last_clean":"2024-04-16T12:57:59.409385+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:59.409385+0000","last_undegraded":"2024-04-16T12:57:59.409385+0000","last_fullsized":"2024-04-16T12:57:59.409385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:06.185 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:06.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.301+0000 7fe9d7674640 1 Processor -- start 2024-04-16T12:58:06.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.301+0000 7fe9d7674640 1 -- start start 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d7674640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d00b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d7674640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9d01492c0 0x7fe9d00b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d7674640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d0149720 con 0x7fe9d00b4590 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d7674640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d009d7b0 con 0x7fe9d01492c0 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d7674640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d006dee0 con 0x7fe9d006db00 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d4c0f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9d01492c0 0x7fe9d00b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d5c11640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe9d00b4590 0x7fe9d0143000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42974/0 (socket says 172.21.15.106:42974) 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d5c11640 1 -- 172.21.15.106:0/1631829204 learned_addr learned my addr 172.21.15.106:0/1631829204 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:06.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d5410640 1 --2- 172.21.15.106:0/1631829204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d00b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d4c0f640 1 -- 172.21.15.106:0/1631829204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 msgr2=0x7fe9d00b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d4c0f640 1 --2- 172.21.15.106:0/1631829204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d00b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d4c0f640 1 -- 172.21.15.106:0/1631829204 >> v1:172.21.15.106:6789/0 conn(0x7fe9d00b4590 legacy=0x7fe9d0143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9d4c0f640 1 -- 172.21.15.106:0/1631829204 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d00b5170 con 0x7fe9d01492c0 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.302+0000 7fe9c7fff640 1 -- 172.21.15.106:0/1631829204 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441309945 0 0) 0x7fe9d0149720 con 0x7fe9d00b4590 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.303+0000 7fe9d4c0f640 1 --2- 172.21.15.106:0/1631829204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d01492c0 0x7fe9d00b4050 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00097a0 tx=0x7fe9c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44daf73df40e043 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.303+0000 7fe9c7fff640 1 -- 172.21.15.106:0/1631829204 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00315a0 con 0x7fe9d01492c0 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.303+0000 7fe9c7fff640 1 -- 172.21.15.106:0/1631829204 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c0037070 con 0x7fe9d01492c0 2024-04-16T12:58:06.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.303+0000 7fe9c7fff640 1 -- 172.21.15.106:0/1631829204 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0031960 con 0x7fe9d01492c0 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 -- 172.21.15.106:0/1631829204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d01492c0 msgr2=0x7fe9d00b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 --2- 172.21.15.106:0/1631829204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d01492c0 0x7fe9d00b4050 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00097a0 tx=0x7fe9c002b840 comp rx=0 tx=0).stop 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 -- 172.21.15.106:0/1631829204 shutdown_connections 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 --2- 172.21.15.106:0/1631829204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d01492c0 0x7fe9d00b4050 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 --2- 172.21.15.106:0/1631829204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d00b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 -- 172.21.15.106:0/1631829204 >> 172.21.15.106:0/1631829204 conn(0x7fe9d009cc10 msgr2=0x7fe9d006d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 -- 172.21.15.106:0/1631829204 shutdown_connections 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.304+0000 7fe9d7674640 1 -- 172.21.15.106:0/1631829204 wait complete. 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.305+0000 7fe9d7674640 1 Processor -- start 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.305+0000 7fe9d7674640 1 -- start start 2024-04-16T12:58:06.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d7674640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d0072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d7674640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d00b4590 0x7fe9d009ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d7674640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9d01492c0 0x7fe9d009bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d7674640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d0143890 con 0x7fe9d00b4590 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d7674640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d0143710 con 0x7fe9d01492c0 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d7674640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d0143a10 con 0x7fe9d006db00 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d00b4590 0x7fe9d009ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d00b4590 0x7fe9d009ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38804/0 (socket says 172.21.15.106:38804) 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 -- 172.21.15.106:0/2553075971 learned_addr learned my addr 172.21.15.106:0/2553075971 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d5410640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d0072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d5c11640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9d01492c0 0x7fe9d009bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 -- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 msgr2=0x7fe9d0072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d0072b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 -- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9d01492c0 msgr2=0x7fe9d009bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9d01492c0 0x7fe9d009bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 -- 172.21.15.106:0/2553075971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d0071960 con 0x7fe9d00b4590 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d5c11640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9d01492c0 0x7fe9d009bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9d4c0f640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d00b4590 0x7fe9d009ba90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0034040 tx=0x7fe9c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.306+0000 7fe9c5ffb640 1 -- 172.21.15.106:0/2553075971 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0032630 con 0x7fe9d00b4590 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.307+0000 7fe9c5ffb640 1 -- 172.21.15.106:0/2553075971 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c00327f0 con 0x7fe9d00b4590 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.307+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d00733d0 con 0x7fe9d00b4590 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.307+0000 7fe9c5ffb640 1 -- 172.21.15.106:0/2553075971 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0032be0 con 0x7fe9d00b4590 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.307+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d008e270 con 0x7fe9d00b4590 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.308+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d0068a90 con 0x7fe9d00b4590 2024-04-16T12:58:06.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.308+0000 7fe9c5ffb640 1 -- 172.21.15.106:0/2553075971 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9c004e430 con 0x7fe9d00b4590 2024-04-16T12:58:06.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.309+0000 7fe9c5ffb640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe9b406c8f0 0x7fe9b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.309+0000 7fe9d5410640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe9b406c8f0 0x7fe9b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.309+0000 7fe9c5ffb640 1 -- 172.21.15.106:0/2553075971 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fe9c002f030 con 0x7fe9d00b4590 2024-04-16T12:58:06.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.309+0000 7fe9d5410640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe9b406c8f0 0x7fe9b406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9d006d710 tx=0x7fe9cc00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:06.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.313+0000 7fe9c5ffb640 1 -- 172.21.15.106:0/2553075971 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9c0040070 con 0x7fe9d00b4590 2024-04-16T12:58:06.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.490+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9d0073c70 con 0x7fe9b406c8f0 2024-04-16T12:58:06.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.495+0000 7fe9c5ffb640 1 -- 172.21.15.106:0/2553075971 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fe9d0073c70 con 0x7fe9b406c8f0 2024-04-16T12:58:06.500 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:06.501 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.498+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe9b406c8f0 msgr2=0x7fe9b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.498+0000 7fe9d7674640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe9b406c8f0 0x7fe9b406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9d006d710 tx=0x7fe9cc00b040 comp rx=0 tx=0).stop 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.498+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d00b4590 msgr2=0x7fe9d009ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.498+0000 7fe9d7674640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d00b4590 0x7fe9d009ba90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0034040 tx=0x7fe9c00046c0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 shutdown_connections 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe9b406c8f0 0x7fe9b406edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9d01492c0 0x7fe9d009bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d00b4590 0x7fe9d009ba90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 --2- 172.21.15.106:0/2553075971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9d006db00 0x7fe9d0072b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 >> 172.21.15.106:0/2553075971 conn(0x7fe9d009cc10 msgr2=0x7fe9d006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 shutdown_connections 2024-04-16T12:58:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.499+0000 7fe9d7674640 1 -- 172.21.15.106:0/2553075971 wait complete. 2024-04-16T12:58:06.511 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-16T12:58:06.174335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001564"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557061+0000","last_change":"2024-04-16T12:57:58.417066+0000","last_active":"2024-04-16T12:57:59.557061+0000","last_peered":"2024-04-16T12:57:59.557061+0000","last_clean":"2024-04-16T12:57:59.557061+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:57:59.557061+0000","last_undegraded":"2024-04-16T12:57:59.557061+0000","last_fullsized":"2024-04-16T12:57:59.557061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:40.783094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557293+0000","last_change":"2024-04-16T12:57:58.414223+0000","last_active":"2024-04-16T12:57:59.557293+0000","last_peered":"2024-04-16T12:57:59.557293+0000","last_clean":"2024-04-16T12:57:59.557293+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:57:59.557293+0000","last_undegraded":"2024-04-16T12:57:59.557293+0000","last_fullsized":"2024-04-16T12:57:59.557293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:04.064696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408863+0000","last_change":"2024-04-16T12:57:58.429706+0000","last_active":"2024-04-16T12:57:59.408863+0000","last_peered":"2024-04-16T12:57:59.408863+0000","last_clean":"2024-04-16T12:57:59.408863+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:57:59.408863+0000","last_undegraded":"2024-04-16T12:57:59.408863+0000","last_fullsized":"2024-04-16T12:57:59.408863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410150+0000","last_change":"2024-04-16T12:57:58.432119+0000","last_active":"2024-04-16T12:57:59.410150+0000","last_peered":"2024-04-16T12:57:59.410150+0000","last_clean":"2024-04-16T12:57:59.410150+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:57:59.410150+0000","last_undegraded":"2024-04-16T12:57:59.410150+0000","last_fullsized":"2024-04-16T12:57:59.410150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557573+0000","last_change":"2024-04-16T12:57:58.415012+0000","last_active":"2024-04-16T12:57:59.557573+0000","last_peered":"2024-04-16T12:57:59.557573+0000","last_clean":"2024-04-16T12:57:59.557573+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:57:59.557573+0000","last_undegraded":"2024-04-16T12:57:59.557573+0000","last_fullsized":"2024-04-16T12:57:59.557573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:02.447913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556831+0000","last_change":"2024-04-16T12:57:58.423617+0000","last_active":"2024-04-16T12:57:59.556831+0000","last_peered":"2024-04-16T12:57:59.556831+0000","last_clean":"2024-04-16T12:57:59.556831+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:57:59.556831+0000","last_undegraded":"2024-04-16T12:57:59.556831+0000","last_fullsized":"2024-04-16T12:57:59.556831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409523+0000","last_change":"2024-04-16T12:57:58.421176+0000","last_active":"2024-04-16T12:57:59.409523+0000","last_peered":"2024-04-16T12:57:59.409523+0000","last_clean":"2024-04-16T12:57:59.409523+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:57:59.409523+0000","last_undegraded":"2024-04-16T12:57:59.409523+0000","last_fullsized":"2024-04-16T12:57:59.409523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408717+0000","last_change":"2024-04-16T12:57:58.420336+0000","last_active":"2024-04-16T12:57:59.408717+0000","last_peered":"2024-04-16T12:57:59.408717+0000","last_clean":"2024-04-16T12:57:59.408717+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:57:59.408717+0000","last_undegraded":"2024-04-16T12:57:59.408717+0000","last_fullsized":"2024-04-16T12:57:59.408717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557536+0000","last_change":"2024-04-16T12:57:58.427221+0000","last_active":"2024-04-16T12:57:59.557536+0000","last_peered":"2024-04-16T12:57:59.557536+0000","last_clean":"2024-04-16T12:57:59.557536+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:57:59.557536+0000","last_undegraded":"2024-04-16T12:57:59.557536+0000","last_fullsized":"2024-04-16T12:57:59.557536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410349+0000","last_change":"2024-04-16T12:57:58.414532+0000","last_active":"2024-04-16T12:57:59.410349+0000","last_peered":"2024-04-16T12:57:59.410349+0000","last_clean":"2024-04-16T12:57:59.410349+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:57:59.410349+0000","last_undegraded":"2024-04-16T12:57:59.410349+0000","last_fullsized":"2024-04-16T12:57:59.410349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:33.604830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409656+0000","last_change":"2024-04-16T12:57:58.419590+0000","last_active":"2024-04-16T12:57:59.409656+0000","last_peered":"2024-04-16T12:57:59.409656+0000","last_clean":"2024-04-16T12:57:59.409656+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:57:59.409656+0000","last_undegraded":"2024-04-16T12:57:59.409656+0000","last_fullsized":"2024-04-16T12:57:59.409656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408763+0000","last_change":"2024-04-16T12:57:58.420968+0000","last_active":"2024-04-16T12:57:59.408763+0000","last_peered":"2024-04-16T12:57:59.408763+0000","last_clean":"2024-04-16T12:57:59.408763+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:57:59.408763+0000","last_undegraded":"2024-04-16T12:57:59.408763+0000","last_fullsized":"2024-04-16T12:57:59.408763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557659+0000","last_change":"2024-04-16T12:57:58.424597+0000","last_active":"2024-04-16T12:57:59.557659+0000","last_peered":"2024-04-16T12:57:59.557659+0000","last_clean":"2024-04-16T12:57:59.557659+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:57:59.557659+0000","last_undegraded":"2024-04-16T12:57:59.557659+0000","last_fullsized":"2024-04-16T12:57:59.557659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:58.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556986+0000","last_change":"2024-04-16T12:57:58.411816+0000","last_active":"2024-04-16T12:57:59.556986+0000","last_peered":"2024-04-16T12:57:59.556986+0000","last_clean":"2024-04-16T12:57:59.556986+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:57:59.556986+0000","last_undegraded":"2024-04-16T12:57:59.556986+0000","last_fullsized":"2024-04-16T12:57:59.556986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408901+0000","last_change":"2024-04-16T12:57:58.419271+0000","last_active":"2024-04-16T12:57:59.408901+0000","last_peered":"2024-04-16T12:57:59.408901+0000","last_clean":"2024-04-16T12:57:59.408901+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:57:59.408901+0000","last_undegraded":"2024-04-16T12:57:59.408901+0000","last_fullsized":"2024-04-16T12:57:59.408901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409323+0000","last_change":"2024-04-16T12:57:58.421606+0000","last_active":"2024-04-16T12:57:59.409323+0000","last_peered":"2024-04-16T12:57:59.409323+0000","last_clean":"2024-04-16T12:57:59.409323+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:57:59.409323+0000","last_undegraded":"2024-04-16T12:57:59.409323+0000","last_fullsized":"2024-04-16T12:57:59.409323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409307+0000","last_change":"2024-04-16T12:57:58.421726+0000","last_active":"2024-04-16T12:57:59.409307+0000","last_peered":"2024-04-16T12:57:59.409307+0000","last_clean":"2024-04-16T12:57:59.409307+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:57:59.409307+0000","last_undegraded":"2024-04-16T12:57:59.409307+0000","last_fullsized":"2024-04-16T12:57:59.409307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557302+0000","last_change":"2024-04-16T12:57:58.417403+0000","last_active":"2024-04-16T12:57:59.557302+0000","last_peered":"2024-04-16T12:57:59.557302+0000","last_clean":"2024-04-16T12:57:59.557302+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:57:59.557302+0000","last_undegraded":"2024-04-16T12:57:59.557302+0000","last_fullsized":"2024-04-16T12:57:59.557302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:24.189968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556932+0000","last_change":"2024-04-16T12:57:58.423377+0000","last_active":"2024-04-16T12:57:59.556932+0000","last_peered":"2024-04-16T12:57:59.556932+0000","last_clean":"2024-04-16T12:57:59.556932+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:57:59.556932+0000","last_undegraded":"2024-04-16T12:57:59.556932+0000","last_fullsized":"2024-04-16T12:57:59.556932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557686+0000","last_change":"2024-04-16T12:57:58.422790+0000","last_active":"2024-04-16T12:57:59.557686+0000","last_peered":"2024-04-16T12:57:59.557686+0000","last_clean":"2024-04-16T12:57:59.557686+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:57:59.557686+0000","last_undegraded":"2024-04-16T12:57:59.557686+0000","last_fullsized":"2024-04-16T12:57:59.557686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:04.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557897+0000","last_change":"2024-04-16T12:57:58.432630+0000","last_active":"2024-04-16T12:57:59.557897+0000","last_peered":"2024-04-16T12:57:59.557897+0000","last_clean":"2024-04-16T12:57:59.557897+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:57:59.557897+0000","last_undegraded":"2024-04-16T12:57:59.557897+0000","last_fullsized":"2024-04-16T12:57:59.557897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557157+0000","last_change":"2024-04-16T12:57:58.428165+0000","last_active":"2024-04-16T12:57:59.557157+0000","last_peered":"2024-04-16T12:57:59.557157+0000","last_clean":"2024-04-16T12:57:59.557157+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:57:59.557157+0000","last_undegraded":"2024-04-16T12:57:59.557157+0000","last_fullsized":"2024-04-16T12:57:59.557157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556657+0000","last_change":"2024-04-16T12:57:58.419322+0000","last_active":"2024-04-16T12:57:59.556657+0000","last_peered":"2024-04-16T12:57:59.556657+0000","last_clean":"2024-04-16T12:57:59.556657+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:57:59.556657+0000","last_undegraded":"2024-04-16T12:57:59.556657+0000","last_fullsized":"2024-04-16T12:57:59.556657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408594+0000","last_change":"2024-04-16T12:57:58.425245+0000","last_active":"2024-04-16T12:57:59.408594+0000","last_peered":"2024-04-16T12:57:59.408594+0000","last_clean":"2024-04-16T12:57:59.408594+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:57:59.408594+0000","last_undegraded":"2024-04-16T12:57:59.408594+0000","last_fullsized":"2024-04-16T12:57:59.408594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410326+0000","last_change":"2024-04-16T12:57:58.422256+0000","last_active":"2024-04-16T12:57:59.410326+0000","last_peered":"2024-04-16T12:57:59.410326+0000","last_clean":"2024-04-16T12:57:59.410326+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:57:59.410326+0000","last_undegraded":"2024-04-16T12:57:59.410326+0000","last_fullsized":"2024-04-16T12:57:59.410326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557449+0000","last_change":"2024-04-16T12:57:58.421697+0000","last_active":"2024-04-16T12:57:59.557449+0000","last_peered":"2024-04-16T12:57:59.557449+0000","last_clean":"2024-04-16T12:57:59.557449+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:57:59.557449+0000","last_undegraded":"2024-04-16T12:57:59.557449+0000","last_fullsized":"2024-04-16T12:57:59.557449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:39.008329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410430+0000","last_change":"2024-04-16T12:57:58.429064+0000","last_active":"2024-04-16T12:57:59.410430+0000","last_peered":"2024-04-16T12:57:59.410430+0000","last_clean":"2024-04-16T12:57:59.410430+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:57:59.410430+0000","last_undegraded":"2024-04-16T12:57:59.410430+0000","last_fullsized":"2024-04-16T12:57:59.410430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408814+0000","last_change":"2024-04-16T12:57:58.420144+0000","last_active":"2024-04-16T12:57:59.408814+0000","last_peered":"2024-04-16T12:57:59.408814+0000","last_clean":"2024-04-16T12:57:59.408814+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:57:59.408814+0000","last_undegraded":"2024-04-16T12:57:59.408814+0000","last_fullsized":"2024-04-16T12:57:59.408814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557851+0000","last_change":"2024-04-16T12:57:58.428551+0000","last_active":"2024-04-16T12:57:59.557851+0000","last_peered":"2024-04-16T12:57:59.557851+0000","last_clean":"2024-04-16T12:57:59.557851+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:57:59.557851+0000","last_undegraded":"2024-04-16T12:57:59.557851+0000","last_fullsized":"2024-04-16T12:57:59.557851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408962+0000","last_change":"2024-04-16T12:57:58.419164+0000","last_active":"2024-04-16T12:57:59.408962+0000","last_peered":"2024-04-16T12:57:59.408962+0000","last_clean":"2024-04-16T12:57:59.408962+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:57:59.408962+0000","last_undegraded":"2024-04-16T12:57:59.408962+0000","last_fullsized":"2024-04-16T12:57:59.408962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557022+0000","last_change":"2024-04-16T12:57:58.417480+0000","last_active":"2024-04-16T12:57:59.557022+0000","last_peered":"2024-04-16T12:57:59.557022+0000","last_clean":"2024-04-16T12:57:59.557022+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:57:59.557022+0000","last_undegraded":"2024-04-16T12:57:59.557022+0000","last_fullsized":"2024-04-16T12:57:59.557022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:55:29.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408880+0000","last_change":"2024-04-16T12:57:58.429121+0000","last_active":"2024-04-16T12:57:59.408880+0000","last_peered":"2024-04-16T12:57:59.408880+0000","last_clean":"2024-04-16T12:57:59.408880+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:57:59.408880+0000","last_undegraded":"2024-04-16T12:57:59.408880+0000","last_fullsized":"2024-04-16T12:57:59.408880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.529728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557103+0000","last_change":"2024-04-16T12:57:58.425769+0000","last_active":"2024-04-16T12:57:59.557103+0000","last_peered":"2024-04-16T12:57:59.557103+0000","last_clean":"2024-04-16T12:57:59.557103+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:57:59.557103+0000","last_undegraded":"2024-04-16T12:57:59.557103+0000","last_fullsized":"2024-04-16T12:57:59.557103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557168+0000","last_change":"2024-04-16T12:57:57.419875+0000","last_active":"2024-04-16T12:57:59.557168+0000","last_peered":"2024-04-16T12:57:59.557168+0000","last_clean":"2024-04-16T12:57:59.557168+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:57:59.557168+0000","last_undegraded":"2024-04-16T12:57:59.557168+0000","last_fullsized":"2024-04-16T12:57:59.557168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556949+0000","last_change":"2024-04-16T12:57:58.429507+0000","last_active":"2024-04-16T12:57:59.556949+0000","last_peered":"2024-04-16T12:57:59.556949+0000","last_clean":"2024-04-16T12:57:59.556949+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:57:59.556949+0000","last_undegraded":"2024-04-16T12:57:59.556949+0000","last_fullsized":"2024-04-16T12:57:59.556949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:48.320225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557195+0000","last_change":"2024-04-16T12:57:57.409560+0000","last_active":"2024-04-16T12:57:59.557195+0000","last_peered":"2024-04-16T12:57:59.557195+0000","last_clean":"2024-04-16T12:57:59.557195+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:57:59.557195+0000","last_undegraded":"2024-04-16T12:57:59.557195+0000","last_fullsized":"2024-04-16T12:57:59.557195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557564+0000","last_change":"2024-04-16T12:57:58.430344+0000","last_active":"2024-04-16T12:57:59.557564+0000","last_peered":"2024-04-16T12:57:59.557564+0000","last_clean":"2024-04-16T12:57:59.557564+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:57:59.557564+0000","last_undegraded":"2024-04-16T12:57:59.557564+0000","last_fullsized":"2024-04-16T12:57:59.557564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557003+0000","last_change":"2024-04-16T12:57:57.421388+0000","last_active":"2024-04-16T12:57:59.557003+0000","last_peered":"2024-04-16T12:57:59.557003+0000","last_clean":"2024-04-16T12:57:59.557003+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:57:59.557003+0000","last_undegraded":"2024-04-16T12:57:59.557003+0000","last_fullsized":"2024-04-16T12:57:59.557003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:23.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410459+0000","last_change":"2024-04-16T12:57:58.427164+0000","last_active":"2024-04-16T12:57:59.410459+0000","last_peered":"2024-04-16T12:57:59.410459+0000","last_clean":"2024-04-16T12:57:59.410459+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:57:59.410459+0000","last_undegraded":"2024-04-16T12:57:59.410459+0000","last_fullsized":"2024-04-16T12:57:59.410459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557793+0000","last_change":"2024-04-16T12:57:57.419891+0000","last_active":"2024-04-16T12:57:59.557793+0000","last_peered":"2024-04-16T12:57:59.557793+0000","last_clean":"2024-04-16T12:57:59.557793+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:57:59.557793+0000","last_undegraded":"2024-04-16T12:57:59.557793+0000","last_fullsized":"2024-04-16T12:57:59.557793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:48.386771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409438+0000","last_change":"2024-04-16T12:57:58.428187+0000","last_active":"2024-04-16T12:57:59.409438+0000","last_peered":"2024-04-16T12:57:59.409438+0000","last_clean":"2024-04-16T12:57:59.409438+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:57:59.409438+0000","last_undegraded":"2024-04-16T12:57:59.409438+0000","last_fullsized":"2024-04-16T12:57:59.409438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557927+0000","last_change":"2024-04-16T12:57:57.419136+0000","last_active":"2024-04-16T12:57:59.557927+0000","last_peered":"2024-04-16T12:57:59.557927+0000","last_clean":"2024-04-16T12:57:59.557927+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:57:59.557927+0000","last_undegraded":"2024-04-16T12:57:59.557927+0000","last_fullsized":"2024-04-16T12:57:59.557927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408786+0000","last_change":"2024-04-16T12:57:58.428624+0000","last_active":"2024-04-16T12:57:59.408786+0000","last_peered":"2024-04-16T12:57:59.408786+0000","last_clean":"2024-04-16T12:57:59.408786+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:57:59.408786+0000","last_undegraded":"2024-04-16T12:57:59.408786+0000","last_fullsized":"2024-04-16T12:57:59.408786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557287+0000","last_change":"2024-04-16T12:57:57.418607+0000","last_active":"2024-04-16T12:57:59.557287+0000","last_peered":"2024-04-16T12:57:59.557287+0000","last_clean":"2024-04-16T12:57:59.557287+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:57:59.557287+0000","last_undegraded":"2024-04-16T12:57:59.557287+0000","last_fullsized":"2024-04-16T12:57:59.557287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:17.248246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556971+0000","last_change":"2024-04-16T12:57:58.426553+0000","last_active":"2024-04-16T12:57:59.556971+0000","last_peered":"2024-04-16T12:57:59.556971+0000","last_clean":"2024-04-16T12:57:59.556971+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:57:59.556971+0000","last_undegraded":"2024-04-16T12:57:59.556971+0000","last_fullsized":"2024-04-16T12:57:59.556971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556800+0000","last_change":"2024-04-16T12:57:57.418496+0000","last_active":"2024-04-16T12:57:59.556800+0000","last_peered":"2024-04-16T12:57:59.556800+0000","last_clean":"2024-04-16T12:57:59.556800+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:57:59.556800+0000","last_undegraded":"2024-04-16T12:57:59.556800+0000","last_fullsized":"2024-04-16T12:57:59.556800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409997+0000","last_change":"2024-04-16T12:57:58.421803+0000","last_active":"2024-04-16T12:57:59.409997+0000","last_peered":"2024-04-16T12:57:59.409997+0000","last_clean":"2024-04-16T12:57:59.409997+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:57:59.409997+0000","last_undegraded":"2024-04-16T12:57:59.409997+0000","last_fullsized":"2024-04-16T12:57:59.409997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557158+0000","last_change":"2024-04-16T12:57:57.417993+0000","last_active":"2024-04-16T12:57:59.557158+0000","last_peered":"2024-04-16T12:57:59.557158+0000","last_clean":"2024-04-16T12:57:59.557158+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:57:59.557158+0000","last_undegraded":"2024-04-16T12:57:59.557158+0000","last_fullsized":"2024-04-16T12:57:59.557158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:27:27.583239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409611+0000","last_change":"2024-04-16T12:57:58.421729+0000","last_active":"2024-04-16T12:57:59.409611+0000","last_peered":"2024-04-16T12:57:59.409611+0000","last_clean":"2024-04-16T12:57:59.409611+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:57:59.409611+0000","last_undegraded":"2024-04-16T12:57:59.409611+0000","last_fullsized":"2024-04-16T12:57:59.409611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556740+0000","last_change":"2024-04-16T12:57:57.419936+0000","last_active":"2024-04-16T12:57:59.556740+0000","last_peered":"2024-04-16T12:57:59.556740+0000","last_clean":"2024-04-16T12:57:59.556740+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:57:59.556740+0000","last_undegraded":"2024-04-16T12:57:59.556740+0000","last_fullsized":"2024-04-16T12:57:59.556740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:09.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556761+0000","last_change":"2024-04-16T12:57:58.423776+0000","last_active":"2024-04-16T12:57:59.556761+0000","last_peered":"2024-04-16T12:57:59.556761+0000","last_clean":"2024-04-16T12:57:59.556761+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:57:59.556761+0000","last_undegraded":"2024-04-16T12:57:59.556761+0000","last_fullsized":"2024-04-16T12:57:59.556761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557282+0000","last_change":"2024-04-16T12:57:57.418768+0000","last_active":"2024-04-16T12:57:59.557282+0000","last_peered":"2024-04-16T12:57:59.557282+0000","last_clean":"2024-04-16T12:57:59.557282+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:57:59.557282+0000","last_undegraded":"2024-04-16T12:57:59.557282+0000","last_fullsized":"2024-04-16T12:57:59.557282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557137+0000","last_change":"2024-04-16T12:57:58.421105+0000","last_active":"2024-04-16T12:57:59.557137+0000","last_peered":"2024-04-16T12:57:59.557137+0000","last_clean":"2024-04-16T12:57:59.557137+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:57:59.557137+0000","last_undegraded":"2024-04-16T12:57:59.557137+0000","last_fullsized":"2024-04-16T12:57:59.557137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408991+0000","last_change":"2024-04-16T12:57:57.416238+0000","last_active":"2024-04-16T12:57:59.408991+0000","last_peered":"2024-04-16T12:57:59.408991+0000","last_clean":"2024-04-16T12:57:59.408991+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:57:59.408991+0000","last_undegraded":"2024-04-16T12:57:59.408991+0000","last_fullsized":"2024-04-16T12:57:59.408991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408608+0000","last_change":"2024-04-16T12:57:58.428014+0000","last_active":"2024-04-16T12:57:59.408608+0000","last_peered":"2024-04-16T12:57:59.408608+0000","last_clean":"2024-04-16T12:57:59.408608+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:57:59.408608+0000","last_undegraded":"2024-04-16T12:57:59.408608+0000","last_fullsized":"2024-04-16T12:57:59.408608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557150+0000","last_change":"2024-04-16T12:57:57.421382+0000","last_active":"2024-04-16T12:57:59.557150+0000","last_peered":"2024-04-16T12:57:59.557150+0000","last_clean":"2024-04-16T12:57:59.557150+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:57:59.557150+0000","last_undegraded":"2024-04-16T12:57:59.557150+0000","last_fullsized":"2024-04-16T12:57:59.557150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:09.260220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410034+0000","last_change":"2024-04-16T12:57:58.417617+0000","last_active":"2024-04-16T12:57:59.410034+0000","last_peered":"2024-04-16T12:57:59.410034+0000","last_clean":"2024-04-16T12:57:59.410034+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:57:59.410034+0000","last_undegraded":"2024-04-16T12:57:59.410034+0000","last_fullsized":"2024-04-16T12:57:59.410034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.558015+0000","last_change":"2024-04-16T12:57:57.419094+0000","last_active":"2024-04-16T12:57:59.558015+0000","last_peered":"2024-04-16T12:57:59.558015+0000","last_clean":"2024-04-16T12:57:59.558015+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:57:59.558015+0000","last_undegraded":"2024-04-16T12:57:59.558015+0000","last_fullsized":"2024-04-16T12:57:59.558015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557010+0000","last_change":"2024-04-16T12:57:58.414688+0000","last_active":"2024-04-16T12:57:59.557010+0000","last_peered":"2024-04-16T12:57:59.557010+0000","last_clean":"2024-04-16T12:57:59.557010+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:57:59.557010+0000","last_undegraded":"2024-04-16T12:57:59.557010+0000","last_fullsized":"2024-04-16T12:57:59.557010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410019+0000","last_change":"2024-04-16T12:57:57.416542+0000","last_active":"2024-04-16T12:57:59.410019+0000","last_peered":"2024-04-16T12:57:59.410019+0000","last_clean":"2024-04-16T12:57:59.410019+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:57:59.410019+0000","last_undegraded":"2024-04-16T12:57:59.410019+0000","last_fullsized":"2024-04-16T12:57:59.410019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409146+0000","last_change":"2024-04-16T12:57:58.429363+0000","last_active":"2024-04-16T12:57:59.409146+0000","last_peered":"2024-04-16T12:57:59.409146+0000","last_clean":"2024-04-16T12:57:59.409146+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:57:59.409146+0000","last_undegraded":"2024-04-16T12:57:59.409146+0000","last_fullsized":"2024-04-16T12:57:59.409146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557034+0000","last_change":"2024-04-16T12:57:57.417272+0000","last_active":"2024-04-16T12:57:59.557034+0000","last_peered":"2024-04-16T12:57:59.557034+0000","last_clean":"2024-04-16T12:57:59.557034+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:57:59.557034+0000","last_undegraded":"2024-04-16T12:57:59.557034+0000","last_fullsized":"2024-04-16T12:57:59.557034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:19.085142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:58.428318+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556658+0000","last_change":"2024-04-16T12:57:57.418665+0000","last_active":"2024-04-16T12:57:59.556658+0000","last_peered":"2024-04-16T12:57:59.556658+0000","last_clean":"2024-04-16T12:57:59.556658+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:57:59.556658+0000","last_undegraded":"2024-04-16T12:57:59.556658+0000","last_fullsized":"2024-04-16T12:57:59.556658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:39.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557740+0000","last_change":"2024-04-16T12:57:58.424884+0000","last_active":"2024-04-16T12:57:59.557740+0000","last_peered":"2024-04-16T12:57:59.557740+0000","last_clean":"2024-04-16T12:57:59.557740+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:57:59.557740+0000","last_undegraded":"2024-04-16T12:57:59.557740+0000","last_fullsized":"2024-04-16T12:57:59.557740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410365+0000","last_change":"2024-04-16T12:57:57.417511+0000","last_active":"2024-04-16T12:57:59.410365+0000","last_peered":"2024-04-16T12:57:59.410365+0000","last_clean":"2024-04-16T12:57:59.410365+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:57:59.410365+0000","last_undegraded":"2024-04-16T12:57:59.410365+0000","last_fullsized":"2024-04-16T12:57:59.410365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409706+0000","last_change":"2024-04-16T12:57:58.431315+0000","last_active":"2024-04-16T12:57:59.409706+0000","last_peered":"2024-04-16T12:57:59.409706+0000","last_clean":"2024-04-16T12:57:59.409706+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:57:59.409706+0000","last_undegraded":"2024-04-16T12:57:59.409706+0000","last_fullsized":"2024-04-16T12:57:59.409706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557710+0000","last_change":"2024-04-16T12:57:57.419368+0000","last_active":"2024-04-16T12:57:59.557710+0000","last_peered":"2024-04-16T12:57:59.557710+0000","last_clean":"2024-04-16T12:57:59.557710+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:57:59.557710+0000","last_undegraded":"2024-04-16T12:57:59.557710+0000","last_fullsized":"2024-04-16T12:57:59.557710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410299+0000","last_change":"2024-04-16T12:57:58.431490+0000","last_active":"2024-04-16T12:57:59.410299+0000","last_peered":"2024-04-16T12:57:59.410299+0000","last_clean":"2024-04-16T12:57:59.410299+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:57:59.410299+0000","last_undegraded":"2024-04-16T12:57:59.410299+0000","last_fullsized":"2024-04-16T12:57:59.410299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557329+0000","last_change":"2024-04-16T12:57:57.418637+0000","last_active":"2024-04-16T12:57:59.557329+0000","last_peered":"2024-04-16T12:57:59.557329+0000","last_clean":"2024-04-16T12:57:59.557329+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:57:59.557329+0000","last_undegraded":"2024-04-16T12:57:59.557329+0000","last_fullsized":"2024-04-16T12:57:59.557329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:49.553356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557676+0000","last_change":"2024-04-16T12:57:58.420291+0000","last_active":"2024-04-16T12:57:59.557676+0000","last_peered":"2024-04-16T12:57:59.557676+0000","last_clean":"2024-04-16T12:57:59.557676+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:57:59.557676+0000","last_undegraded":"2024-04-16T12:57:59.557676+0000","last_fullsized":"2024-04-16T12:57:59.557676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557561+0000","last_change":"2024-04-16T12:57:57.420173+0000","last_active":"2024-04-16T12:57:59.557561+0000","last_peered":"2024-04-16T12:57:59.557561+0000","last_clean":"2024-04-16T12:57:59.557561+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:57:59.557561+0000","last_undegraded":"2024-04-16T12:57:59.557561+0000","last_fullsized":"2024-04-16T12:57:59.557561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:01.440156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556745+0000","last_change":"2024-04-16T12:57:58.428239+0000","last_active":"2024-04-16T12:57:59.556745+0000","last_peered":"2024-04-16T12:57:59.556745+0000","last_clean":"2024-04-16T12:57:59.556745+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:57:59.556745+0000","last_undegraded":"2024-04-16T12:57:59.556745+0000","last_fullsized":"2024-04-16T12:57:59.556745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:18.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557492+0000","last_change":"2024-04-16T12:57:57.416742+0000","last_active":"2024-04-16T12:57:59.557492+0000","last_peered":"2024-04-16T12:57:59.557492+0000","last_clean":"2024-04-16T12:57:59.557492+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:57:59.557492+0000","last_undegraded":"2024-04-16T12:57:59.557492+0000","last_fullsized":"2024-04-16T12:57:59.557492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:28.073205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557717+0000","last_change":"2024-04-16T12:57:58.415256+0000","last_active":"2024-04-16T12:57:59.557717+0000","last_peered":"2024-04-16T12:57:59.557717+0000","last_clean":"2024-04-16T12:57:59.557717+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:57:59.557717+0000","last_undegraded":"2024-04-16T12:57:59.557717+0000","last_fullsized":"2024-04-16T12:57:59.557717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:44.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:57.418163+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556520+0000","last_change":"2024-04-16T12:57:58.422113+0000","last_active":"2024-04-16T12:57:59.556520+0000","last_peered":"2024-04-16T12:57:59.556520+0000","last_clean":"2024-04-16T12:57:59.556520+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:57:59.556520+0000","last_undegraded":"2024-04-16T12:57:59.556520+0000","last_fullsized":"2024-04-16T12:57:59.556520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:50.561113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557093+0000","last_change":"2024-04-16T12:57:57.420836+0000","last_active":"2024-04-16T12:57:59.557093+0000","last_peered":"2024-04-16T12:57:59.557093+0000","last_clean":"2024-04-16T12:57:59.557093+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:57:59.557093+0000","last_undegraded":"2024-04-16T12:57:59.557093+0000","last_fullsized":"2024-04-16T12:57:59.557093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409271+0000","last_change":"2024-04-16T12:57:58.418246+0000","last_active":"2024-04-16T12:57:59.409271+0000","last_peered":"2024-04-16T12:57:59.409271+0000","last_clean":"2024-04-16T12:57:59.409271+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:57:59.409271+0000","last_undegraded":"2024-04-16T12:57:59.409271+0000","last_fullsized":"2024-04-16T12:57:59.409271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408689+0000","last_change":"2024-04-16T12:57:57.415493+0000","last_active":"2024-04-16T12:57:59.408689+0000","last_peered":"2024-04-16T12:57:59.408689+0000","last_clean":"2024-04-16T12:57:59.408689+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:57:59.408689+0000","last_undegraded":"2024-04-16T12:57:59.408689+0000","last_fullsized":"2024-04-16T12:57:59.408689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557558+0000","last_change":"2024-04-16T12:57:58.424345+0000","last_active":"2024-04-16T12:57:59.557558+0000","last_peered":"2024-04-16T12:57:59.557558+0000","last_clean":"2024-04-16T12:57:59.557558+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:57:59.557558+0000","last_undegraded":"2024-04-16T12:57:59.557558+0000","last_fullsized":"2024-04-16T12:57:59.557558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:44.705042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410427+0000","last_change":"2024-04-16T12:57:57.419610+0000","last_active":"2024-04-16T12:57:59.410427+0000","last_peered":"2024-04-16T12:57:59.410427+0000","last_clean":"2024-04-16T12:57:59.410427+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:57:59.410427+0000","last_undegraded":"2024-04-16T12:57:59.410427+0000","last_fullsized":"2024-04-16T12:57:59.410427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:00:29.563675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409731+0000","last_change":"2024-04-16T12:57:58.428160+0000","last_active":"2024-04-16T12:57:59.409731+0000","last_peered":"2024-04-16T12:57:59.409731+0000","last_clean":"2024-04-16T12:57:59.409731+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:57:59.409731+0000","last_undegraded":"2024-04-16T12:57:59.409731+0000","last_fullsized":"2024-04-16T12:57:59.409731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557366+0000","last_change":"2024-04-16T12:57:57.415967+0000","last_active":"2024-04-16T12:57:59.557366+0000","last_peered":"2024-04-16T12:57:59.557366+0000","last_clean":"2024-04-16T12:57:59.557366+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:57:59.557366+0000","last_undegraded":"2024-04-16T12:57:59.557366+0000","last_fullsized":"2024-04-16T12:57:59.557366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556899+0000","last_change":"2024-04-16T12:57:58.419642+0000","last_active":"2024-04-16T12:57:59.556899+0000","last_peered":"2024-04-16T12:57:59.556899+0000","last_clean":"2024-04-16T12:57:59.556899+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:57:59.556899+0000","last_undegraded":"2024-04-16T12:57:59.556899+0000","last_fullsized":"2024-04-16T12:57:59.556899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410370+0000","last_change":"2024-04-16T12:57:57.416214+0000","last_active":"2024-04-16T12:57:59.410370+0000","last_peered":"2024-04-16T12:57:59.410370+0000","last_clean":"2024-04-16T12:57:59.410370+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:57:59.410370+0000","last_undegraded":"2024-04-16T12:57:59.410370+0000","last_fullsized":"2024-04-16T12:57:59.410370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557237+0000","last_change":"2024-04-16T12:57:58.420763+0000","last_active":"2024-04-16T12:57:59.557237+0000","last_peered":"2024-04-16T12:57:59.557237+0000","last_clean":"2024-04-16T12:57:59.557237+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:57:59.557237+0000","last_undegraded":"2024-04-16T12:57:59.557237+0000","last_fullsized":"2024-04-16T12:57:59.557237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557670+0000","last_change":"2024-04-16T12:57:57.413675+0000","last_active":"2024-04-16T12:57:59.557670+0000","last_peered":"2024-04-16T12:57:59.557670+0000","last_clean":"2024-04-16T12:57:59.557670+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:57:59.557670+0000","last_undegraded":"2024-04-16T12:57:59.557670+0000","last_fullsized":"2024-04-16T12:57:59.557670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557738+0000","last_change":"2024-04-16T12:57:58.417795+0000","last_active":"2024-04-16T12:57:59.557738+0000","last_peered":"2024-04-16T12:57:59.557738+0000","last_clean":"2024-04-16T12:57:59.557738+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:57:59.557738+0000","last_undegraded":"2024-04-16T12:57:59.557738+0000","last_fullsized":"2024-04-16T12:57:59.557738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410124+0000","last_change":"2024-04-16T12:57:57.418446+0000","last_active":"2024-04-16T12:57:59.410124+0000","last_peered":"2024-04-16T12:57:59.410124+0000","last_clean":"2024-04-16T12:57:59.410124+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:57:59.410124+0000","last_undegraded":"2024-04-16T12:57:59.410124+0000","last_fullsized":"2024-04-16T12:57:59.410124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556666+0000","last_change":"2024-04-16T12:57:58.415348+0000","last_active":"2024-04-16T12:57:59.556666+0000","last_peered":"2024-04-16T12:57:59.556666+0000","last_clean":"2024-04-16T12:57:59.556666+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:57:59.556666+0000","last_undegraded":"2024-04-16T12:57:59.556666+0000","last_fullsized":"2024-04-16T12:57:59.556666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557259+0000","last_change":"2024-04-16T12:57:57.424470+0000","last_active":"2024-04-16T12:57:59.557259+0000","last_peered":"2024-04-16T12:57:59.557259+0000","last_clean":"2024-04-16T12:57:59.557259+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:57:59.557259+0000","last_undegraded":"2024-04-16T12:57:59.557259+0000","last_fullsized":"2024-04-16T12:57:59.557259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:43.697285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556938+0000","last_change":"2024-04-16T12:57:58.428240+0000","last_active":"2024-04-16T12:57:59.556938+0000","last_peered":"2024-04-16T12:57:59.556938+0000","last_clean":"2024-04-16T12:57:59.556938+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:57:59.556938+0000","last_undegraded":"2024-04-16T12:57:59.556938+0000","last_fullsized":"2024-04-16T12:57:59.556938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556773+0000","last_change":"2024-04-16T12:57:57.416527+0000","last_active":"2024-04-16T12:57:59.556773+0000","last_peered":"2024-04-16T12:57:59.556773+0000","last_clean":"2024-04-16T12:57:59.556773+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:57:59.556773+0000","last_undegraded":"2024-04-16T12:57:59.556773+0000","last_fullsized":"2024-04-16T12:57:59.556773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408749+0000","last_change":"2024-04-16T12:57:58.422936+0000","last_active":"2024-04-16T12:57:59.408749+0000","last_peered":"2024-04-16T12:57:59.408749+0000","last_clean":"2024-04-16T12:57:59.408749+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:57:59.408749+0000","last_undegraded":"2024-04-16T12:57:59.408749+0000","last_fullsized":"2024-04-16T12:57:59.408749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556749+0000","last_change":"2024-04-16T12:57:57.418379+0000","last_active":"2024-04-16T12:57:59.556749+0000","last_peered":"2024-04-16T12:57:59.556749+0000","last_clean":"2024-04-16T12:57:59.556749+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:57:59.556749+0000","last_undegraded":"2024-04-16T12:57:59.556749+0000","last_fullsized":"2024-04-16T12:57:59.556749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409385+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:59.409385+0000","last_peered":"2024-04-16T12:57:59.409385+0000","last_clean":"2024-04-16T12:57:59.409385+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:59.409385+0000","last_undegraded":"2024-04-16T12:57:59.409385+0000","last_fullsized":"2024-04-16T12:57:59.409385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:06.515 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T12:58:06.515 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T12:58:06.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.660+0000 7fc4b040c640 1 Processor -- start 2024-04-16T12:58:06.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.660+0000 7fc4b040c640 1 -- start start 2024-04-16T12:58:06.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4b040c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b78a0 0x7fc4a806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4b040c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4a806e520 0x7fc4a8141a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4b040c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a80b7c80 con 0x7fc4a80b6100 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4b040c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a80b6f80 con 0x7fc4a806e520 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4b040c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a80b1d80 con 0x7fc4a80b78a0 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ad9a7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4a806e520 0x7fc4a8141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ae9a9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc4a80b6100 0x7fc4a8147cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42982/0 (socket says 172.21.15.106:42982) 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ae9a9640 1 -- 172.21.15.106:0/1307133854 learned_addr learned my addr 172.21.15.106:0/1307133854 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ae1a8640 1 --2- 172.21.15.106:0/1307133854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b78a0 0x7fc4a806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ad9a7640 1 -- 172.21.15.106:0/1307133854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b78a0 msgr2=0x7fc4a806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ad9a7640 1 --2- 172.21.15.106:0/1307133854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b78a0 0x7fc4a806dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ad9a7640 1 -- 172.21.15.106:0/1307133854 >> v1:172.21.15.106:6789/0 conn(0x7fc4a80b6100 legacy=0x7fc4a8147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ad1a6640 1 -- 172.21.15.106:0/1307133854 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185530211 0 0) 0x7fc4a80b7c80 con 0x7fc4a80b6100 2024-04-16T12:58:06.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.661+0000 7fc4ad9a7640 1 -- 172.21.15.106:0/1307133854 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a80b22a0 con 0x7fc4a806e520 2024-04-16T12:58:06.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.662+0000 7fc4ad9a7640 1 --2- 172.21.15.106:0/1307133854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a8141a90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc4980097a0 tx=0x7fc49802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7f37c1ec50beb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:06.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.662+0000 7fc4ad1a6640 1 -- 172.21.15.106:0/1307133854 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498038070 con 0x7fc4a806e520 2024-04-16T12:58:06.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.662+0000 7fc4ad1a6640 1 -- 172.21.15.106:0/1307133854 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498031700 con 0x7fc4a806e520 2024-04-16T12:58:06.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.662+0000 7fc4ad1a6640 1 -- 172.21.15.106:0/1307133854 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498031ad0 con 0x7fc4a806e520 2024-04-16T12:58:06.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 -- 172.21.15.106:0/1307133854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 msgr2=0x7fc4a8141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1307133854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a8141a90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc4980097a0 tx=0x7fc49802b7a0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 -- 172.21.15.106:0/1307133854 shutdown_connections 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1307133854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a8141a90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1307133854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b78a0 0x7fc4a806dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 -- 172.21.15.106:0/1307133854 >> 172.21.15.106:0/1307133854 conn(0x7fc4a80b7e90 msgr2=0x7fc4a80b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 -- 172.21.15.106:0/1307133854 shutdown_connections 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.663+0000 7fc4b040c640 1 -- 172.21.15.106:0/1307133854 wait complete. 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 Processor -- start 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 -- start start 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a814b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b6100 0x7fc4a80b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4a80b78a0 0x7fc4a81d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a80b5f10 con 0x7fc4a806e520 2024-04-16T12:58:06.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a80b5d90 con 0x7fc4a80b78a0 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.664+0000 7fc4b040c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a8141fd0 con 0x7fc4a80b6100 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a814b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a814b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38822/0 (socket says 172.21.15.106:38822) 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 -- 172.21.15.106:0/1319560563 learned_addr learned my addr 172.21.15.106:0/1319560563 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ad9a7640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b6100 0x7fc4a80b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 -- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b6100 msgr2=0x7fc4a80b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b6100 0x7fc4a80b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 -- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4a80b78a0 msgr2=0x7fc4a81d70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae9a9640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4a80b78a0 0x7fc4a81d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4a80b78a0 0x7fc4a81d70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 -- 172.21.15.106:0/1319560563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a814bd60 con 0x7fc4a806e520 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4ae1a8640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a814b380 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400e870 tx=0x7fc4a400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:06.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc49effd640 1 -- 172.21.15.106:0/1319560563 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4017070 con 0x7fc4a806e520 2024-04-16T12:58:06.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc49effd640 1 -- 172.21.15.106:0/1319560563 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a400c940 con 0x7fc4a806e520 2024-04-16T12:58:06.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a81dd7b0 con 0x7fc4a806e520 2024-04-16T12:58:06.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc49effd640 1 -- 172.21.15.106:0/1319560563 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400cd30 con 0x7fc4a806e520 2024-04-16T12:58:06.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.665+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a81ddd70 con 0x7fc4a806e520 2024-04-16T12:58:06.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.666+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a806c210 con 0x7fc4a806e520 2024-04-16T12:58:06.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.667+0000 7fc49effd640 1 -- 172.21.15.106:0/1319560563 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4a401a070 con 0x7fc4a806e520 2024-04-16T12:58:06.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.667+0000 7fc49effd640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc48c06c920 0x7fc48c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:06.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.667+0000 7fc49effd640 1 -- 172.21.15.106:0/1319560563 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fc4a408bcc0 con 0x7fc4a806e520 2024-04-16T12:58:06.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.667+0000 7fc4ad9a7640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc48c06c920 0x7fc48c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:06.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.668+0000 7fc4ad9a7640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc48c06c920 0x7fc48c06ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc498035000 tx=0x7fc498008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:06.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.672+0000 7fc49effd640 1 -- 172.21.15.106:0/1319560563 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4a405a180 con 0x7fc4a806e520 2024-04-16T12:58:06.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.918+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc4a8068a90 con 0x7fc4a806e520 2024-04-16T12:58:06.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.922+0000 7fc49effd640 1 -- 172.21.15.106:0/1319560563 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fc4a4059a80 con 0x7fc4a806e520 2024-04-16T12:58:06.923 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-04-16T12:58:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB1dR5m+WbUERAAd0Ad0MV0D4YY+D2NE++aGQ== 2024-04-16T12:58:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: caps mds = "allow" 2024-04-16T12:58:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: caps mon = "allow r" 2024-04-16T12:58:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T12:58:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.0 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc48c06c920 msgr2=0x7fc48c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc48c06c920 0x7fc48c06ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc498035000 tx=0x7fc498008030 comp rx=0 tx=0).stop 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 msgr2=0x7fc4a814b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a814b380 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400e870 tx=0x7fc4a400ed30 comp rx=0 tx=0).stop 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 shutdown_connections 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc48c06c920 0x7fc48c06ede0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4a80b78a0 0x7fc4a81d70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4a80b6100 0x7fc4a80b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 --2- 172.21.15.106:0/1319560563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4a806e520 0x7fc4a814b380 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 >> 172.21.15.106:0/1319560563 conn(0x7fc4a80b7e90 msgr2=0x7fc4a813dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 shutdown_connections 2024-04-16T12:58:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:06.924+0000 7fc4b040c640 1 -- 172.21.15.106:0/1319560563 wait complete. 2024-04-16T12:58:06.937 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:58:07.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.038+0000 7fc4d75e2640 1 Processor -- start 2024-04-16T12:58:07.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.038+0000 7fc4d75e2640 1 -- start start 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d75e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d0144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d75e2640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4d0145240 0x7fc4d0152600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d75e2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d00bc350 con 0x7fc4d00bbf70 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d75e2640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d006fa40 con 0x7fc4d0145240 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d75e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d006f760 con 0x7fc4d0070750 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d5b7f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4d0145240 0x7fc4d0152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d5b7f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4d0145240 0x7fc4d0152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38832/0 (socket says 172.21.15.106:38832) 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/3830387733 learned_addr learned my addr 172.21.15.106:0/3830387733 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:07.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d4b7d640 1 --2- 172.21.15.106:0/3830387733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d0144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/3830387733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 msgr2=0x7fc4d0144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d5b7f640 1 --2- 172.21.15.106:0/3830387733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d0144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.039+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/3830387733 >> v1:172.21.15.171:6789/0 conn(0x7fc4d00bbf70 legacy=0x7fc4d0147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.040+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/3830387733 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d00b6220 con 0x7fc4d0145240 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.040+0000 7fc4d5b7f640 1 --2- 172.21.15.106:0/3830387733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d0152600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009870 tx=0x7fc4c802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce86e334b9494b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.040+0000 7fc4c7fff640 1 -- 172.21.15.106:0/3830387733 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80317c0 con 0x7fc4d0145240 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.040+0000 7fc4c7fff640 1 -- 172.21.15.106:0/3830387733 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c8037070 con 0x7fc4d0145240 2024-04-16T12:58:07.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.040+0000 7fc4c7fff640 1 -- 172.21.15.106:0/3830387733 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8031b80 con 0x7fc4d0145240 2024-04-16T12:58:07.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 -- 172.21.15.106:0/3830387733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 msgr2=0x7fc4d0152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/3830387733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d0152600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009870 tx=0x7fc4c802b860 comp rx=0 tx=0).stop 2024-04-16T12:58:07.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 -- 172.21.15.106:0/3830387733 shutdown_connections 2024-04-16T12:58:07.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/3830387733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d0152600 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/3830387733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d0144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 -- 172.21.15.106:0/3830387733 >> 172.21.15.106:0/3830387733 conn(0x7fc4d009aa60 msgr2=0x7fc4d00bb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 -- 172.21.15.106:0/3830387733 shutdown_connections 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.041+0000 7fc4d75e2640 1 -- 172.21.15.106:0/3830387733 wait complete. 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.042+0000 7fc4d75e2640 1 Processor -- start 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.042+0000 7fc4d75e2640 1 -- start start 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d75e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d01d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d75e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4d00bbf70 0x7fc4d01cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d75e2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d01e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d75e2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d006f3a0 con 0x7fc4d0145240 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d75e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d01456d0 con 0x7fc4d00bbf70 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d75e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d006f520 con 0x7fc4d0070750 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d01e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d01e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38838/0 (socket says 172.21.15.106:38838) 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/76628137 learned_addr learned my addr 172.21.15.106:0/76628137 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d4b7d640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4d00bbf70 0x7fc4d01cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d537e640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d01d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 msgr2=0x7fc4d01d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d01d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4d00bbf70 msgr2=0x7fc4d01cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4d00bbf70 0x7fc4d01cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 -- 172.21.15.106:0/76628137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d01e1390 con 0x7fc4d0145240 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d4b7d640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4d00bbf70 0x7fc4d01cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d5b7f640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d01e17e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009870 tx=0x7fc4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4c5ffb640 1 -- 172.21.15.106:0/76628137 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8032860 con 0x7fc4d0145240 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4c5ffb640 1 -- 172.21.15.106:0/76628137 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c8032a00 con 0x7fc4d0145240 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d0147860 con 0x7fc4d0145240 2024-04-16T12:58:07.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.043+0000 7fc4c5ffb640 1 -- 172.21.15.106:0/76628137 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8032df0 con 0x7fc4d0145240 2024-04-16T12:58:07.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.044+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d0147580 con 0x7fc4d0145240 2024-04-16T12:58:07.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.045+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d0075540 con 0x7fc4d0145240 2024-04-16T12:58:07.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.045+0000 7fc4c5ffb640 1 -- 172.21.15.106:0/76628137 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4c804c060 con 0x7fc4d0145240 2024-04-16T12:58:07.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.046+0000 7fc4c5ffb640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc4b406c8f0 0x7fc4b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.046+0000 7fc4c5ffb640 1 -- 172.21.15.106:0/76628137 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fc4c80ad650 con 0x7fc4d0145240 2024-04-16T12:58:07.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.046+0000 7fc4d537e640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc4b406c8f0 0x7fc4b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.046+0000 7fc4d537e640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc4b406c8f0 0x7fc4b406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc001f10 tx=0x7fc4cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:07.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.050+0000 7fc4c5ffb640 1 -- 172.21.15.106:0/76628137 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4d0075540 con 0x7fc4d0145240 2024-04-16T12:58:07.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.262+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4d00a09f0 con 0x7fc4d0145240 2024-04-16T12:58:07.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.262+0000 7fc4c5ffb640 1 -- 172.21.15.106:0/76628137 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+3537 (secure 0 0 0) 0x7fc4d00a09f0 con 0x7fc4d0145240 2024-04-16T12:58:07.264 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:07.264 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/2467066081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2467066081},{"type":"v1","addr":"172.21.15.171:6833","nonce":2467066081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:57.765565+0000","modified":"2024-04-16T12:58:00.138283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6835/4094660060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4094660060},{"type":"v1","addr":"172.21.15.106:6835","nonce":4094660060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4986,"qdb_cluster":[4986]},"id":2}]} 2024-04-16T12:58:07.264 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 14 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc4b406c8f0 msgr2=0x7fc4b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc4b406c8f0 0x7fc4b406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc001f10 tx=0x7fc4cc009040 comp rx=0 tx=0).stop 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 msgr2=0x7fc4d01e17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d01e17e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009870 tx=0x7fc4c80046c0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 shutdown_connections 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc4b406c8f0 0x7fc4b406edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4d0145240 0x7fc4d01e17e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4d00bbf70 0x7fc4d01cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 --2- 172.21.15.106:0/76628137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d0070750 0x7fc4d01d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 >> 172.21.15.106:0/76628137 conn(0x7fc4d009aa60 msgr2=0x7fc4d00b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 shutdown_connections 2024-04-16T12:58:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.264+0000 7fc4d75e2640 1 -- 172.21.15.106:0/76628137 wait complete. 2024-04-16T12:58:07.278 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed ... ERROR 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner: 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/test_cephfs_shell.py", line 44, in setUp 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner: super(TestCephFSShell, self).setUp() 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T12:58:07.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner:Ran 1 test in 28.806s 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner: 2024-04-16T12:58:07.280 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/test_cephfs_shell.py", line 44, in setUp 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: super(TestCephFSShell, self).setUp() 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T12:58:07.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T12:58:07.282 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T12:58:07.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T12:58:07.282 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T12:58:07.282 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T12:58:07.282 INFO:tasks.cephfs_test_runner: 2024-04-16T12:58:07.282 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-16T12:58:07.526 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=312ea8964fdc4f59ae28dfc9115adda9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-16T12:58:07.527 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-16T12:58:07.536 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-16T12:58:07.579 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-16T12:58:07.579 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-16T12:58:07.579 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:58:07.600 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056370,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497688k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=329 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497688k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-04-16T12:58:07.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:58:07.600 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-16T12:58:07.657 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T12:58:07.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:58:07.658 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:58:07.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:58:07.728 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-04-16T12:58:07.830 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T12:58:07.839 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T12:58:07.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:07.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.942+0000 7f05f995f640 1 Processor -- start 2024-04-16T12:58:07.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.942+0000 7f05f995f640 1 -- start start 2024-04-16T12:58:07.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.942+0000 7f05f995f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f409d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.942+0000 7f05f995f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05f4144db0 0x7f05f40b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.942+0000 7f05f995f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f40b3fc0 con 0x7f05f40afee0 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.942+0000 7f05f995f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f05f40b9720 con 0x7f05f4144db0 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.942+0000 7f05f995f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f05f40b9a00 con 0x7f05f40b4a50 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f37fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05f4144db0 0x7f05f40b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f37fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05f4144db0 0x7f05f40b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38846/0 (socket says 172.21.15.106:38846) 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f37fe640 1 -- 172.21.15.106:0/500890123 learned_addr learned my addr 172.21.15.106:0/500890123 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:07.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f2ffd640 1 --2- 172.21.15.106:0/500890123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f409d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f37fe640 1 -- 172.21.15.106:0/500890123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 msgr2=0x7f05f409d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f37fe640 1 --2- 172.21.15.106:0/500890123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f409d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f37fe640 1 -- 172.21.15.106:0/500890123 >> v1:172.21.15.171:6789/0 conn(0x7f05f40afee0 legacy=0x7f05f41446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f37fe640 1 -- 172.21.15.106:0/500890123 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f409dd30 con 0x7f05f4144db0 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.943+0000 7f05f2ffd640 1 --2- 172.21.15.106:0/500890123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f409d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.944+0000 7f05f37fe640 1 --2- 172.21.15.106:0/500890123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f40b0340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009e50 tx=0x7f05ec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0bfc9a51bc81d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.944+0000 7f05f27fc640 1 -- 172.21.15.106:0/500890123 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec02c9e0 con 0x7f05f4144db0 2024-04-16T12:58:07.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.944+0000 7f05f27fc640 1 -- 172.21.15.106:0/500890123 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ec02cb80 con 0x7f05f4144db0 2024-04-16T12:58:07.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.944+0000 7f05f27fc640 1 -- 172.21.15.106:0/500890123 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0343f0 con 0x7f05f4144db0 2024-04-16T12:58:07.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 -- 172.21.15.106:0/500890123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 msgr2=0x7f05f40b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 --2- 172.21.15.106:0/500890123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f40b0340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009e50 tx=0x7f05ec02be40 comp rx=0 tx=0).stop 2024-04-16T12:58:07.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 -- 172.21.15.106:0/500890123 shutdown_connections 2024-04-16T12:58:07.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 --2- 172.21.15.106:0/500890123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f40b0340 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 --2- 172.21.15.106:0/500890123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f409d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 -- 172.21.15.106:0/500890123 >> 172.21.15.106:0/500890123 conn(0x7f05f409cc10 msgr2=0x7f05f406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:07.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 -- 172.21.15.106:0/500890123 shutdown_connections 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.945+0000 7f05f995f640 1 -- 172.21.15.106:0/500890123 wait complete. 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.946+0000 7f05f995f640 1 Processor -- start 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.946+0000 7f05f995f640 1 -- start start 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.946+0000 7f05f995f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05f40afee0 0x7f05f40b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.946+0000 7f05f995f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f4070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.946+0000 7f05f995f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f41477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.946+0000 7f05f995f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f05f414eb10 con 0x7f05f4144db0 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f995f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f05f40b93b0 con 0x7f05f40afee0 2024-04-16T12:58:07.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f995f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f05f414ec90 con 0x7f05f40b4a50 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f41477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f41477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38860/0 (socket says 172.21.15.106:38860) 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 -- 172.21.15.106:0/419296866 learned_addr learned my addr 172.21.15.106:0/419296866 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f2ffd640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05f40afee0 0x7f05f40b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05ea7fc640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f4070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 -- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 msgr2=0x7f05f4070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f4070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 -- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05f40afee0 msgr2=0x7f05f40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:07.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05f40afee0 0x7f05f40b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 -- 172.21.15.106:0/419296866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f4071ec0 con 0x7f05f4144db0 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f37fe640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f41477f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05ec036040 tx=0x7f05ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f0ff9640 1 -- 172.21.15.106:0/419296866 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec044020 con 0x7f05f4144db0 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f0ff9640 1 -- 172.21.15.106:0/419296866 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ec040690 con 0x7f05f4144db0 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f4073130 con 0x7f05f4144db0 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f0ff9640 1 -- 172.21.15.106:0/419296866 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec040a80 con 0x7f05f4144db0 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.947+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f40b61b0 con 0x7f05f4144db0 2024-04-16T12:58:07.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.948+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f4068a90 con 0x7f05f4144db0 2024-04-16T12:58:07.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.949+0000 7f05f0ff9640 1 -- 172.21.15.106:0/419296866 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05ec047020 con 0x7f05f4144db0 2024-04-16T12:58:07.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.949+0000 7f05f0ff9640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f05d406c8f0 0x7f05d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:07.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.949+0000 7f05f0ff9640 1 -- 172.21.15.106:0/419296866 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f05ec0ae5e0 con 0x7f05f4144db0 2024-04-16T12:58:07.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.949+0000 7f05f2ffd640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f05d406c8f0 0x7f05d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:07.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.950+0000 7f05f2ffd640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f05d406c8f0 0x7f05d406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05f41421b0 tx=0x7f05e4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:07.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:07.954+0000 7f05f0ff9640 1 -- 172.21.15.106:0/419296866 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05ec04e030 con 0x7f05f4144db0 2024-04-16T12:58:08.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.125+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05f4072090 con 0x7f05d406c8f0 2024-04-16T12:58:08.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.131+0000 7f05f0ff9640 1 -- 172.21.15.106:0/419296866 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f05f4072090 con 0x7f05d406c8f0 2024-04-16T12:58:08.135 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:08.136 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f05d406c8f0 msgr2=0x7f05d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f05d406c8f0 0x7f05d406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05f41421b0 tx=0x7f05e4008040 comp rx=0 tx=0).stop 2024-04-16T12:58:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 msgr2=0x7f05f41477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f41477f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05ec036040 tx=0x7f05ec004a40 comp rx=0 tx=0).stop 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 shutdown_connections 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f05d406c8f0 0x7f05d406edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f4144db0 0x7f05f41477f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05f40b4a50 0x7f05f4070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 --2- 172.21.15.106:0/419296866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05f40afee0 0x7f05f40b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 >> 172.21.15.106:0/419296866 conn(0x7f05f409cc10 msgr2=0x7f05f409bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:08.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 shutdown_connections 2024-04-16T12:58:08.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.134+0000 7f05f995f640 1 -- 172.21.15.106:0/419296866 wait complete. 2024-04-16T12:58:08.147 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-16T12:58:06.174335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001564"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557061+0000","last_change":"2024-04-16T12:57:58.417066+0000","last_active":"2024-04-16T12:57:59.557061+0000","last_peered":"2024-04-16T12:57:59.557061+0000","last_clean":"2024-04-16T12:57:59.557061+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:57:59.557061+0000","last_undegraded":"2024-04-16T12:57:59.557061+0000","last_fullsized":"2024-04-16T12:57:59.557061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:40.783094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557293+0000","last_change":"2024-04-16T12:57:58.414223+0000","last_active":"2024-04-16T12:57:59.557293+0000","last_peered":"2024-04-16T12:57:59.557293+0000","last_clean":"2024-04-16T12:57:59.557293+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:57:59.557293+0000","last_undegraded":"2024-04-16T12:57:59.557293+0000","last_fullsized":"2024-04-16T12:57:59.557293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:04.064696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408863+0000","last_change":"2024-04-16T12:57:58.429706+0000","last_active":"2024-04-16T12:57:59.408863+0000","last_peered":"2024-04-16T12:57:59.408863+0000","last_clean":"2024-04-16T12:57:59.408863+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:57:59.408863+0000","last_undegraded":"2024-04-16T12:57:59.408863+0000","last_fullsized":"2024-04-16T12:57:59.408863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410150+0000","last_change":"2024-04-16T12:57:58.432119+0000","last_active":"2024-04-16T12:57:59.410150+0000","last_peered":"2024-04-16T12:57:59.410150+0000","last_clean":"2024-04-16T12:57:59.410150+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:57:59.410150+0000","last_undegraded":"2024-04-16T12:57:59.410150+0000","last_fullsized":"2024-04-16T12:57:59.410150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557573+0000","last_change":"2024-04-16T12:57:58.415012+0000","last_active":"2024-04-16T12:57:59.557573+0000","last_peered":"2024-04-16T12:57:59.557573+0000","last_clean":"2024-04-16T12:57:59.557573+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:57:59.557573+0000","last_undegraded":"2024-04-16T12:57:59.557573+0000","last_fullsized":"2024-04-16T12:57:59.557573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:02.447913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556831+0000","last_change":"2024-04-16T12:57:58.423617+0000","last_active":"2024-04-16T12:57:59.556831+0000","last_peered":"2024-04-16T12:57:59.556831+0000","last_clean":"2024-04-16T12:57:59.556831+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:57:59.556831+0000","last_undegraded":"2024-04-16T12:57:59.556831+0000","last_fullsized":"2024-04-16T12:57:59.556831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409523+0000","last_change":"2024-04-16T12:57:58.421176+0000","last_active":"2024-04-16T12:57:59.409523+0000","last_peered":"2024-04-16T12:57:59.409523+0000","last_clean":"2024-04-16T12:57:59.409523+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:57:59.409523+0000","last_undegraded":"2024-04-16T12:57:59.409523+0000","last_fullsized":"2024-04-16T12:57:59.409523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408717+0000","last_change":"2024-04-16T12:57:58.420336+0000","last_active":"2024-04-16T12:57:59.408717+0000","last_peered":"2024-04-16T12:57:59.408717+0000","last_clean":"2024-04-16T12:57:59.408717+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:57:59.408717+0000","last_undegraded":"2024-04-16T12:57:59.408717+0000","last_fullsized":"2024-04-16T12:57:59.408717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557536+0000","last_change":"2024-04-16T12:57:58.427221+0000","last_active":"2024-04-16T12:57:59.557536+0000","last_peered":"2024-04-16T12:57:59.557536+0000","last_clean":"2024-04-16T12:57:59.557536+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:57:59.557536+0000","last_undegraded":"2024-04-16T12:57:59.557536+0000","last_fullsized":"2024-04-16T12:57:59.557536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410349+0000","last_change":"2024-04-16T12:57:58.414532+0000","last_active":"2024-04-16T12:57:59.410349+0000","last_peered":"2024-04-16T12:57:59.410349+0000","last_clean":"2024-04-16T12:57:59.410349+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:57:59.410349+0000","last_undegraded":"2024-04-16T12:57:59.410349+0000","last_fullsized":"2024-04-16T12:57:59.410349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:33.604830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409656+0000","last_change":"2024-04-16T12:57:58.419590+0000","last_active":"2024-04-16T12:57:59.409656+0000","last_peered":"2024-04-16T12:57:59.409656+0000","last_clean":"2024-04-16T12:57:59.409656+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:57:59.409656+0000","last_undegraded":"2024-04-16T12:57:59.409656+0000","last_fullsized":"2024-04-16T12:57:59.409656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408763+0000","last_change":"2024-04-16T12:57:58.420968+0000","last_active":"2024-04-16T12:57:59.408763+0000","last_peered":"2024-04-16T12:57:59.408763+0000","last_clean":"2024-04-16T12:57:59.408763+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:57:59.408763+0000","last_undegraded":"2024-04-16T12:57:59.408763+0000","last_fullsized":"2024-04-16T12:57:59.408763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557659+0000","last_change":"2024-04-16T12:57:58.424597+0000","last_active":"2024-04-16T12:57:59.557659+0000","last_peered":"2024-04-16T12:57:59.557659+0000","last_clean":"2024-04-16T12:57:59.557659+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:57:59.557659+0000","last_undegraded":"2024-04-16T12:57:59.557659+0000","last_fullsized":"2024-04-16T12:57:59.557659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:58.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556986+0000","last_change":"2024-04-16T12:57:58.411816+0000","last_active":"2024-04-16T12:57:59.556986+0000","last_peered":"2024-04-16T12:57:59.556986+0000","last_clean":"2024-04-16T12:57:59.556986+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:57:59.556986+0000","last_undegraded":"2024-04-16T12:57:59.556986+0000","last_fullsized":"2024-04-16T12:57:59.556986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408901+0000","last_change":"2024-04-16T12:57:58.419271+0000","last_active":"2024-04-16T12:57:59.408901+0000","last_peered":"2024-04-16T12:57:59.408901+0000","last_clean":"2024-04-16T12:57:59.408901+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:57:59.408901+0000","last_undegraded":"2024-04-16T12:57:59.408901+0000","last_fullsized":"2024-04-16T12:57:59.408901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409323+0000","last_change":"2024-04-16T12:57:58.421606+0000","last_active":"2024-04-16T12:57:59.409323+0000","last_peered":"2024-04-16T12:57:59.409323+0000","last_clean":"2024-04-16T12:57:59.409323+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:57:59.409323+0000","last_undegraded":"2024-04-16T12:57:59.409323+0000","last_fullsized":"2024-04-16T12:57:59.409323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409307+0000","last_change":"2024-04-16T12:57:58.421726+0000","last_active":"2024-04-16T12:57:59.409307+0000","last_peered":"2024-04-16T12:57:59.409307+0000","last_clean":"2024-04-16T12:57:59.409307+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:57:59.409307+0000","last_undegraded":"2024-04-16T12:57:59.409307+0000","last_fullsized":"2024-04-16T12:57:59.409307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557302+0000","last_change":"2024-04-16T12:57:58.417403+0000","last_active":"2024-04-16T12:57:59.557302+0000","last_peered":"2024-04-16T12:57:59.557302+0000","last_clean":"2024-04-16T12:57:59.557302+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:57:59.557302+0000","last_undegraded":"2024-04-16T12:57:59.557302+0000","last_fullsized":"2024-04-16T12:57:59.557302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:24.189968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556932+0000","last_change":"2024-04-16T12:57:58.423377+0000","last_active":"2024-04-16T12:57:59.556932+0000","last_peered":"2024-04-16T12:57:59.556932+0000","last_clean":"2024-04-16T12:57:59.556932+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:57:59.556932+0000","last_undegraded":"2024-04-16T12:57:59.556932+0000","last_fullsized":"2024-04-16T12:57:59.556932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557686+0000","last_change":"2024-04-16T12:57:58.422790+0000","last_active":"2024-04-16T12:57:59.557686+0000","last_peered":"2024-04-16T12:57:59.557686+0000","last_clean":"2024-04-16T12:57:59.557686+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:57:59.557686+0000","last_undegraded":"2024-04-16T12:57:59.557686+0000","last_fullsized":"2024-04-16T12:57:59.557686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:04.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557897+0000","last_change":"2024-04-16T12:57:58.432630+0000","last_active":"2024-04-16T12:57:59.557897+0000","last_peered":"2024-04-16T12:57:59.557897+0000","last_clean":"2024-04-16T12:57:59.557897+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:57:59.557897+0000","last_undegraded":"2024-04-16T12:57:59.557897+0000","last_fullsized":"2024-04-16T12:57:59.557897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557157+0000","last_change":"2024-04-16T12:57:58.428165+0000","last_active":"2024-04-16T12:57:59.557157+0000","last_peered":"2024-04-16T12:57:59.557157+0000","last_clean":"2024-04-16T12:57:59.557157+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:57:59.557157+0000","last_undegraded":"2024-04-16T12:57:59.557157+0000","last_fullsized":"2024-04-16T12:57:59.557157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556657+0000","last_change":"2024-04-16T12:57:58.419322+0000","last_active":"2024-04-16T12:57:59.556657+0000","last_peered":"2024-04-16T12:57:59.556657+0000","last_clean":"2024-04-16T12:57:59.556657+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:57:59.556657+0000","last_undegraded":"2024-04-16T12:57:59.556657+0000","last_fullsized":"2024-04-16T12:57:59.556657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408594+0000","last_change":"2024-04-16T12:57:58.425245+0000","last_active":"2024-04-16T12:57:59.408594+0000","last_peered":"2024-04-16T12:57:59.408594+0000","last_clean":"2024-04-16T12:57:59.408594+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:57:59.408594+0000","last_undegraded":"2024-04-16T12:57:59.408594+0000","last_fullsized":"2024-04-16T12:57:59.408594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410326+0000","last_change":"2024-04-16T12:57:58.422256+0000","last_active":"2024-04-16T12:57:59.410326+0000","last_peered":"2024-04-16T12:57:59.410326+0000","last_clean":"2024-04-16T12:57:59.410326+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:57:59.410326+0000","last_undegraded":"2024-04-16T12:57:59.410326+0000","last_fullsized":"2024-04-16T12:57:59.410326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557449+0000","last_change":"2024-04-16T12:57:58.421697+0000","last_active":"2024-04-16T12:57:59.557449+0000","last_peered":"2024-04-16T12:57:59.557449+0000","last_clean":"2024-04-16T12:57:59.557449+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:57:59.557449+0000","last_undegraded":"2024-04-16T12:57:59.557449+0000","last_fullsized":"2024-04-16T12:57:59.557449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:39.008329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410430+0000","last_change":"2024-04-16T12:57:58.429064+0000","last_active":"2024-04-16T12:57:59.410430+0000","last_peered":"2024-04-16T12:57:59.410430+0000","last_clean":"2024-04-16T12:57:59.410430+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:57:59.410430+0000","last_undegraded":"2024-04-16T12:57:59.410430+0000","last_fullsized":"2024-04-16T12:57:59.410430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408814+0000","last_change":"2024-04-16T12:57:58.420144+0000","last_active":"2024-04-16T12:57:59.408814+0000","last_peered":"2024-04-16T12:57:59.408814+0000","last_clean":"2024-04-16T12:57:59.408814+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:57:59.408814+0000","last_undegraded":"2024-04-16T12:57:59.408814+0000","last_fullsized":"2024-04-16T12:57:59.408814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557851+0000","last_change":"2024-04-16T12:57:58.428551+0000","last_active":"2024-04-16T12:57:59.557851+0000","last_peered":"2024-04-16T12:57:59.557851+0000","last_clean":"2024-04-16T12:57:59.557851+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:57:59.557851+0000","last_undegraded":"2024-04-16T12:57:59.557851+0000","last_fullsized":"2024-04-16T12:57:59.557851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408962+0000","last_change":"2024-04-16T12:57:58.419164+0000","last_active":"2024-04-16T12:57:59.408962+0000","last_peered":"2024-04-16T12:57:59.408962+0000","last_clean":"2024-04-16T12:57:59.408962+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:57:59.408962+0000","last_undegraded":"2024-04-16T12:57:59.408962+0000","last_fullsized":"2024-04-16T12:57:59.408962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557022+0000","last_change":"2024-04-16T12:57:58.417480+0000","last_active":"2024-04-16T12:57:59.557022+0000","last_peered":"2024-04-16T12:57:59.557022+0000","last_clean":"2024-04-16T12:57:59.557022+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:57:59.557022+0000","last_undegraded":"2024-04-16T12:57:59.557022+0000","last_fullsized":"2024-04-16T12:57:59.557022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:55:29.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408880+0000","last_change":"2024-04-16T12:57:58.429121+0000","last_active":"2024-04-16T12:57:59.408880+0000","last_peered":"2024-04-16T12:57:59.408880+0000","last_clean":"2024-04-16T12:57:59.408880+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:57:59.408880+0000","last_undegraded":"2024-04-16T12:57:59.408880+0000","last_fullsized":"2024-04-16T12:57:59.408880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.529728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557103+0000","last_change":"2024-04-16T12:57:58.425769+0000","last_active":"2024-04-16T12:57:59.557103+0000","last_peered":"2024-04-16T12:57:59.557103+0000","last_clean":"2024-04-16T12:57:59.557103+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:57:59.557103+0000","last_undegraded":"2024-04-16T12:57:59.557103+0000","last_fullsized":"2024-04-16T12:57:59.557103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557168+0000","last_change":"2024-04-16T12:57:57.419875+0000","last_active":"2024-04-16T12:57:59.557168+0000","last_peered":"2024-04-16T12:57:59.557168+0000","last_clean":"2024-04-16T12:57:59.557168+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:57:59.557168+0000","last_undegraded":"2024-04-16T12:57:59.557168+0000","last_fullsized":"2024-04-16T12:57:59.557168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556949+0000","last_change":"2024-04-16T12:57:58.429507+0000","last_active":"2024-04-16T12:57:59.556949+0000","last_peered":"2024-04-16T12:57:59.556949+0000","last_clean":"2024-04-16T12:57:59.556949+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:57:59.556949+0000","last_undegraded":"2024-04-16T12:57:59.556949+0000","last_fullsized":"2024-04-16T12:57:59.556949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:48.320225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557195+0000","last_change":"2024-04-16T12:57:57.409560+0000","last_active":"2024-04-16T12:57:59.557195+0000","last_peered":"2024-04-16T12:57:59.557195+0000","last_clean":"2024-04-16T12:57:59.557195+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:57:59.557195+0000","last_undegraded":"2024-04-16T12:57:59.557195+0000","last_fullsized":"2024-04-16T12:57:59.557195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557564+0000","last_change":"2024-04-16T12:57:58.430344+0000","last_active":"2024-04-16T12:57:59.557564+0000","last_peered":"2024-04-16T12:57:59.557564+0000","last_clean":"2024-04-16T12:57:59.557564+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:57:59.557564+0000","last_undegraded":"2024-04-16T12:57:59.557564+0000","last_fullsized":"2024-04-16T12:57:59.557564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557003+0000","last_change":"2024-04-16T12:57:57.421388+0000","last_active":"2024-04-16T12:57:59.557003+0000","last_peered":"2024-04-16T12:57:59.557003+0000","last_clean":"2024-04-16T12:57:59.557003+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:57:59.557003+0000","last_undegraded":"2024-04-16T12:57:59.557003+0000","last_fullsized":"2024-04-16T12:57:59.557003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:23.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410459+0000","last_change":"2024-04-16T12:57:58.427164+0000","last_active":"2024-04-16T12:57:59.410459+0000","last_peered":"2024-04-16T12:57:59.410459+0000","last_clean":"2024-04-16T12:57:59.410459+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:57:59.410459+0000","last_undegraded":"2024-04-16T12:57:59.410459+0000","last_fullsized":"2024-04-16T12:57:59.410459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557793+0000","last_change":"2024-04-16T12:57:57.419891+0000","last_active":"2024-04-16T12:57:59.557793+0000","last_peered":"2024-04-16T12:57:59.557793+0000","last_clean":"2024-04-16T12:57:59.557793+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:57:59.557793+0000","last_undegraded":"2024-04-16T12:57:59.557793+0000","last_fullsized":"2024-04-16T12:57:59.557793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:48.386771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409438+0000","last_change":"2024-04-16T12:57:58.428187+0000","last_active":"2024-04-16T12:57:59.409438+0000","last_peered":"2024-04-16T12:57:59.409438+0000","last_clean":"2024-04-16T12:57:59.409438+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:57:59.409438+0000","last_undegraded":"2024-04-16T12:57:59.409438+0000","last_fullsized":"2024-04-16T12:57:59.409438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557927+0000","last_change":"2024-04-16T12:57:57.419136+0000","last_active":"2024-04-16T12:57:59.557927+0000","last_peered":"2024-04-16T12:57:59.557927+0000","last_clean":"2024-04-16T12:57:59.557927+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:57:59.557927+0000","last_undegraded":"2024-04-16T12:57:59.557927+0000","last_fullsized":"2024-04-16T12:57:59.557927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408786+0000","last_change":"2024-04-16T12:57:58.428624+0000","last_active":"2024-04-16T12:57:59.408786+0000","last_peered":"2024-04-16T12:57:59.408786+0000","last_clean":"2024-04-16T12:57:59.408786+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:57:59.408786+0000","last_undegraded":"2024-04-16T12:57:59.408786+0000","last_fullsized":"2024-04-16T12:57:59.408786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557287+0000","last_change":"2024-04-16T12:57:57.418607+0000","last_active":"2024-04-16T12:57:59.557287+0000","last_peered":"2024-04-16T12:57:59.557287+0000","last_clean":"2024-04-16T12:57:59.557287+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:57:59.557287+0000","last_undegraded":"2024-04-16T12:57:59.557287+0000","last_fullsized":"2024-04-16T12:57:59.557287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:17.248246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556971+0000","last_change":"2024-04-16T12:57:58.426553+0000","last_active":"2024-04-16T12:57:59.556971+0000","last_peered":"2024-04-16T12:57:59.556971+0000","last_clean":"2024-04-16T12:57:59.556971+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:57:59.556971+0000","last_undegraded":"2024-04-16T12:57:59.556971+0000","last_fullsized":"2024-04-16T12:57:59.556971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556800+0000","last_change":"2024-04-16T12:57:57.418496+0000","last_active":"2024-04-16T12:57:59.556800+0000","last_peered":"2024-04-16T12:57:59.556800+0000","last_clean":"2024-04-16T12:57:59.556800+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:57:59.556800+0000","last_undegraded":"2024-04-16T12:57:59.556800+0000","last_fullsized":"2024-04-16T12:57:59.556800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409997+0000","last_change":"2024-04-16T12:57:58.421803+0000","last_active":"2024-04-16T12:57:59.409997+0000","last_peered":"2024-04-16T12:57:59.409997+0000","last_clean":"2024-04-16T12:57:59.409997+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:57:59.409997+0000","last_undegraded":"2024-04-16T12:57:59.409997+0000","last_fullsized":"2024-04-16T12:57:59.409997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557158+0000","last_change":"2024-04-16T12:57:57.417993+0000","last_active":"2024-04-16T12:57:59.557158+0000","last_peered":"2024-04-16T12:57:59.557158+0000","last_clean":"2024-04-16T12:57:59.557158+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:57:59.557158+0000","last_undegraded":"2024-04-16T12:57:59.557158+0000","last_fullsized":"2024-04-16T12:57:59.557158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:27:27.583239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409611+0000","last_change":"2024-04-16T12:57:58.421729+0000","last_active":"2024-04-16T12:57:59.409611+0000","last_peered":"2024-04-16T12:57:59.409611+0000","last_clean":"2024-04-16T12:57:59.409611+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:57:59.409611+0000","last_undegraded":"2024-04-16T12:57:59.409611+0000","last_fullsized":"2024-04-16T12:57:59.409611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556740+0000","last_change":"2024-04-16T12:57:57.419936+0000","last_active":"2024-04-16T12:57:59.556740+0000","last_peered":"2024-04-16T12:57:59.556740+0000","last_clean":"2024-04-16T12:57:59.556740+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:57:59.556740+0000","last_undegraded":"2024-04-16T12:57:59.556740+0000","last_fullsized":"2024-04-16T12:57:59.556740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:09.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556761+0000","last_change":"2024-04-16T12:57:58.423776+0000","last_active":"2024-04-16T12:57:59.556761+0000","last_peered":"2024-04-16T12:57:59.556761+0000","last_clean":"2024-04-16T12:57:59.556761+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:57:59.556761+0000","last_undegraded":"2024-04-16T12:57:59.556761+0000","last_fullsized":"2024-04-16T12:57:59.556761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557282+0000","last_change":"2024-04-16T12:57:57.418768+0000","last_active":"2024-04-16T12:57:59.557282+0000","last_peered":"2024-04-16T12:57:59.557282+0000","last_clean":"2024-04-16T12:57:59.557282+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:57:59.557282+0000","last_undegraded":"2024-04-16T12:57:59.557282+0000","last_fullsized":"2024-04-16T12:57:59.557282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557137+0000","last_change":"2024-04-16T12:57:58.421105+0000","last_active":"2024-04-16T12:57:59.557137+0000","last_peered":"2024-04-16T12:57:59.557137+0000","last_clean":"2024-04-16T12:57:59.557137+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:57:59.557137+0000","last_undegraded":"2024-04-16T12:57:59.557137+0000","last_fullsized":"2024-04-16T12:57:59.557137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408991+0000","last_change":"2024-04-16T12:57:57.416238+0000","last_active":"2024-04-16T12:57:59.408991+0000","last_peered":"2024-04-16T12:57:59.408991+0000","last_clean":"2024-04-16T12:57:59.408991+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:57:59.408991+0000","last_undegraded":"2024-04-16T12:57:59.408991+0000","last_fullsized":"2024-04-16T12:57:59.408991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408608+0000","last_change":"2024-04-16T12:57:58.428014+0000","last_active":"2024-04-16T12:57:59.408608+0000","last_peered":"2024-04-16T12:57:59.408608+0000","last_clean":"2024-04-16T12:57:59.408608+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:57:59.408608+0000","last_undegraded":"2024-04-16T12:57:59.408608+0000","last_fullsized":"2024-04-16T12:57:59.408608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557150+0000","last_change":"2024-04-16T12:57:57.421382+0000","last_active":"2024-04-16T12:57:59.557150+0000","last_peered":"2024-04-16T12:57:59.557150+0000","last_clean":"2024-04-16T12:57:59.557150+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:57:59.557150+0000","last_undegraded":"2024-04-16T12:57:59.557150+0000","last_fullsized":"2024-04-16T12:57:59.557150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:09.260220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410034+0000","last_change":"2024-04-16T12:57:58.417617+0000","last_active":"2024-04-16T12:57:59.410034+0000","last_peered":"2024-04-16T12:57:59.410034+0000","last_clean":"2024-04-16T12:57:59.410034+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:57:59.410034+0000","last_undegraded":"2024-04-16T12:57:59.410034+0000","last_fullsized":"2024-04-16T12:57:59.410034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.558015+0000","last_change":"2024-04-16T12:57:57.419094+0000","last_active":"2024-04-16T12:57:59.558015+0000","last_peered":"2024-04-16T12:57:59.558015+0000","last_clean":"2024-04-16T12:57:59.558015+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:57:59.558015+0000","last_undegraded":"2024-04-16T12:57:59.558015+0000","last_fullsized":"2024-04-16T12:57:59.558015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557010+0000","last_change":"2024-04-16T12:57:58.414688+0000","last_active":"2024-04-16T12:57:59.557010+0000","last_peered":"2024-04-16T12:57:59.557010+0000","last_clean":"2024-04-16T12:57:59.557010+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:57:59.557010+0000","last_undegraded":"2024-04-16T12:57:59.557010+0000","last_fullsized":"2024-04-16T12:57:59.557010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410019+0000","last_change":"2024-04-16T12:57:57.416542+0000","last_active":"2024-04-16T12:57:59.410019+0000","last_peered":"2024-04-16T12:57:59.410019+0000","last_clean":"2024-04-16T12:57:59.410019+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:57:59.410019+0000","last_undegraded":"2024-04-16T12:57:59.410019+0000","last_fullsized":"2024-04-16T12:57:59.410019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409146+0000","last_change":"2024-04-16T12:57:58.429363+0000","last_active":"2024-04-16T12:57:59.409146+0000","last_peered":"2024-04-16T12:57:59.409146+0000","last_clean":"2024-04-16T12:57:59.409146+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:57:59.409146+0000","last_undegraded":"2024-04-16T12:57:59.409146+0000","last_fullsized":"2024-04-16T12:57:59.409146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557034+0000","last_change":"2024-04-16T12:57:57.417272+0000","last_active":"2024-04-16T12:57:59.557034+0000","last_peered":"2024-04-16T12:57:59.557034+0000","last_clean":"2024-04-16T12:57:59.557034+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:57:59.557034+0000","last_undegraded":"2024-04-16T12:57:59.557034+0000","last_fullsized":"2024-04-16T12:57:59.557034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:19.085142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:58.428318+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556658+0000","last_change":"2024-04-16T12:57:57.418665+0000","last_active":"2024-04-16T12:57:59.556658+0000","last_peered":"2024-04-16T12:57:59.556658+0000","last_clean":"2024-04-16T12:57:59.556658+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:57:59.556658+0000","last_undegraded":"2024-04-16T12:57:59.556658+0000","last_fullsized":"2024-04-16T12:57:59.556658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:39.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557740+0000","last_change":"2024-04-16T12:57:58.424884+0000","last_active":"2024-04-16T12:57:59.557740+0000","last_peered":"2024-04-16T12:57:59.557740+0000","last_clean":"2024-04-16T12:57:59.557740+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:57:59.557740+0000","last_undegraded":"2024-04-16T12:57:59.557740+0000","last_fullsized":"2024-04-16T12:57:59.557740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410365+0000","last_change":"2024-04-16T12:57:57.417511+0000","last_active":"2024-04-16T12:57:59.410365+0000","last_peered":"2024-04-16T12:57:59.410365+0000","last_clean":"2024-04-16T12:57:59.410365+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:57:59.410365+0000","last_undegraded":"2024-04-16T12:57:59.410365+0000","last_fullsized":"2024-04-16T12:57:59.410365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409706+0000","last_change":"2024-04-16T12:57:58.431315+0000","last_active":"2024-04-16T12:57:59.409706+0000","last_peered":"2024-04-16T12:57:59.409706+0000","last_clean":"2024-04-16T12:57:59.409706+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:57:59.409706+0000","last_undegraded":"2024-04-16T12:57:59.409706+0000","last_fullsized":"2024-04-16T12:57:59.409706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557710+0000","last_change":"2024-04-16T12:57:57.419368+0000","last_active":"2024-04-16T12:57:59.557710+0000","last_peered":"2024-04-16T12:57:59.557710+0000","last_clean":"2024-04-16T12:57:59.557710+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:57:59.557710+0000","last_undegraded":"2024-04-16T12:57:59.557710+0000","last_fullsized":"2024-04-16T12:57:59.557710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410299+0000","last_change":"2024-04-16T12:57:58.431490+0000","last_active":"2024-04-16T12:57:59.410299+0000","last_peered":"2024-04-16T12:57:59.410299+0000","last_clean":"2024-04-16T12:57:59.410299+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:57:59.410299+0000","last_undegraded":"2024-04-16T12:57:59.410299+0000","last_fullsized":"2024-04-16T12:57:59.410299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557329+0000","last_change":"2024-04-16T12:57:57.418637+0000","last_active":"2024-04-16T12:57:59.557329+0000","last_peered":"2024-04-16T12:57:59.557329+0000","last_clean":"2024-04-16T12:57:59.557329+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:57:59.557329+0000","last_undegraded":"2024-04-16T12:57:59.557329+0000","last_fullsized":"2024-04-16T12:57:59.557329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:49.553356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557676+0000","last_change":"2024-04-16T12:57:58.420291+0000","last_active":"2024-04-16T12:57:59.557676+0000","last_peered":"2024-04-16T12:57:59.557676+0000","last_clean":"2024-04-16T12:57:59.557676+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:57:59.557676+0000","last_undegraded":"2024-04-16T12:57:59.557676+0000","last_fullsized":"2024-04-16T12:57:59.557676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557561+0000","last_change":"2024-04-16T12:57:57.420173+0000","last_active":"2024-04-16T12:57:59.557561+0000","last_peered":"2024-04-16T12:57:59.557561+0000","last_clean":"2024-04-16T12:57:59.557561+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:57:59.557561+0000","last_undegraded":"2024-04-16T12:57:59.557561+0000","last_fullsized":"2024-04-16T12:57:59.557561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:01.440156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556745+0000","last_change":"2024-04-16T12:57:58.428239+0000","last_active":"2024-04-16T12:57:59.556745+0000","last_peered":"2024-04-16T12:57:59.556745+0000","last_clean":"2024-04-16T12:57:59.556745+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:57:59.556745+0000","last_undegraded":"2024-04-16T12:57:59.556745+0000","last_fullsized":"2024-04-16T12:57:59.556745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:18.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557492+0000","last_change":"2024-04-16T12:57:57.416742+0000","last_active":"2024-04-16T12:57:59.557492+0000","last_peered":"2024-04-16T12:57:59.557492+0000","last_clean":"2024-04-16T12:57:59.557492+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:57:59.557492+0000","last_undegraded":"2024-04-16T12:57:59.557492+0000","last_fullsized":"2024-04-16T12:57:59.557492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:28.073205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557717+0000","last_change":"2024-04-16T12:57:58.415256+0000","last_active":"2024-04-16T12:57:59.557717+0000","last_peered":"2024-04-16T12:57:59.557717+0000","last_clean":"2024-04-16T12:57:59.557717+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:57:59.557717+0000","last_undegraded":"2024-04-16T12:57:59.557717+0000","last_fullsized":"2024-04-16T12:57:59.557717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:44.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:57.418163+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556520+0000","last_change":"2024-04-16T12:57:58.422113+0000","last_active":"2024-04-16T12:57:59.556520+0000","last_peered":"2024-04-16T12:57:59.556520+0000","last_clean":"2024-04-16T12:57:59.556520+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:57:59.556520+0000","last_undegraded":"2024-04-16T12:57:59.556520+0000","last_fullsized":"2024-04-16T12:57:59.556520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:50.561113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557093+0000","last_change":"2024-04-16T12:57:57.420836+0000","last_active":"2024-04-16T12:57:59.557093+0000","last_peered":"2024-04-16T12:57:59.557093+0000","last_clean":"2024-04-16T12:57:59.557093+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:57:59.557093+0000","last_undegraded":"2024-04-16T12:57:59.557093+0000","last_fullsized":"2024-04-16T12:57:59.557093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409271+0000","last_change":"2024-04-16T12:57:58.418246+0000","last_active":"2024-04-16T12:57:59.409271+0000","last_peered":"2024-04-16T12:57:59.409271+0000","last_clean":"2024-04-16T12:57:59.409271+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:57:59.409271+0000","last_undegraded":"2024-04-16T12:57:59.409271+0000","last_fullsized":"2024-04-16T12:57:59.409271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408689+0000","last_change":"2024-04-16T12:57:57.415493+0000","last_active":"2024-04-16T12:57:59.408689+0000","last_peered":"2024-04-16T12:57:59.408689+0000","last_clean":"2024-04-16T12:57:59.408689+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:57:59.408689+0000","last_undegraded":"2024-04-16T12:57:59.408689+0000","last_fullsized":"2024-04-16T12:57:59.408689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557558+0000","last_change":"2024-04-16T12:57:58.424345+0000","last_active":"2024-04-16T12:57:59.557558+0000","last_peered":"2024-04-16T12:57:59.557558+0000","last_clean":"2024-04-16T12:57:59.557558+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:57:59.557558+0000","last_undegraded":"2024-04-16T12:57:59.557558+0000","last_fullsized":"2024-04-16T12:57:59.557558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:44.705042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410427+0000","last_change":"2024-04-16T12:57:57.419610+0000","last_active":"2024-04-16T12:57:59.410427+0000","last_peered":"2024-04-16T12:57:59.410427+0000","last_clean":"2024-04-16T12:57:59.410427+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:57:59.410427+0000","last_undegraded":"2024-04-16T12:57:59.410427+0000","last_fullsized":"2024-04-16T12:57:59.410427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:00:29.563675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409731+0000","last_change":"2024-04-16T12:57:58.428160+0000","last_active":"2024-04-16T12:57:59.409731+0000","last_peered":"2024-04-16T12:57:59.409731+0000","last_clean":"2024-04-16T12:57:59.409731+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:57:59.409731+0000","last_undegraded":"2024-04-16T12:57:59.409731+0000","last_fullsized":"2024-04-16T12:57:59.409731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557366+0000","last_change":"2024-04-16T12:57:57.415967+0000","last_active":"2024-04-16T12:57:59.557366+0000","last_peered":"2024-04-16T12:57:59.557366+0000","last_clean":"2024-04-16T12:57:59.557366+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:57:59.557366+0000","last_undegraded":"2024-04-16T12:57:59.557366+0000","last_fullsized":"2024-04-16T12:57:59.557366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556899+0000","last_change":"2024-04-16T12:57:58.419642+0000","last_active":"2024-04-16T12:57:59.556899+0000","last_peered":"2024-04-16T12:57:59.556899+0000","last_clean":"2024-04-16T12:57:59.556899+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:57:59.556899+0000","last_undegraded":"2024-04-16T12:57:59.556899+0000","last_fullsized":"2024-04-16T12:57:59.556899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410370+0000","last_change":"2024-04-16T12:57:57.416214+0000","last_active":"2024-04-16T12:57:59.410370+0000","last_peered":"2024-04-16T12:57:59.410370+0000","last_clean":"2024-04-16T12:57:59.410370+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:57:59.410370+0000","last_undegraded":"2024-04-16T12:57:59.410370+0000","last_fullsized":"2024-04-16T12:57:59.410370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557237+0000","last_change":"2024-04-16T12:57:58.420763+0000","last_active":"2024-04-16T12:57:59.557237+0000","last_peered":"2024-04-16T12:57:59.557237+0000","last_clean":"2024-04-16T12:57:59.557237+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:57:59.557237+0000","last_undegraded":"2024-04-16T12:57:59.557237+0000","last_fullsized":"2024-04-16T12:57:59.557237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557670+0000","last_change":"2024-04-16T12:57:57.413675+0000","last_active":"2024-04-16T12:57:59.557670+0000","last_peered":"2024-04-16T12:57:59.557670+0000","last_clean":"2024-04-16T12:57:59.557670+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:57:59.557670+0000","last_undegraded":"2024-04-16T12:57:59.557670+0000","last_fullsized":"2024-04-16T12:57:59.557670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557738+0000","last_change":"2024-04-16T12:57:58.417795+0000","last_active":"2024-04-16T12:57:59.557738+0000","last_peered":"2024-04-16T12:57:59.557738+0000","last_clean":"2024-04-16T12:57:59.557738+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:57:59.557738+0000","last_undegraded":"2024-04-16T12:57:59.557738+0000","last_fullsized":"2024-04-16T12:57:59.557738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410124+0000","last_change":"2024-04-16T12:57:57.418446+0000","last_active":"2024-04-16T12:57:59.410124+0000","last_peered":"2024-04-16T12:57:59.410124+0000","last_clean":"2024-04-16T12:57:59.410124+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:57:59.410124+0000","last_undegraded":"2024-04-16T12:57:59.410124+0000","last_fullsized":"2024-04-16T12:57:59.410124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556666+0000","last_change":"2024-04-16T12:57:58.415348+0000","last_active":"2024-04-16T12:57:59.556666+0000","last_peered":"2024-04-16T12:57:59.556666+0000","last_clean":"2024-04-16T12:57:59.556666+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:57:59.556666+0000","last_undegraded":"2024-04-16T12:57:59.556666+0000","last_fullsized":"2024-04-16T12:57:59.556666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557259+0000","last_change":"2024-04-16T12:57:57.424470+0000","last_active":"2024-04-16T12:57:59.557259+0000","last_peered":"2024-04-16T12:57:59.557259+0000","last_clean":"2024-04-16T12:57:59.557259+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:57:59.557259+0000","last_undegraded":"2024-04-16T12:57:59.557259+0000","last_fullsized":"2024-04-16T12:57:59.557259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:43.697285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556938+0000","last_change":"2024-04-16T12:57:58.428240+0000","last_active":"2024-04-16T12:57:59.556938+0000","last_peered":"2024-04-16T12:57:59.556938+0000","last_clean":"2024-04-16T12:57:59.556938+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:57:59.556938+0000","last_undegraded":"2024-04-16T12:57:59.556938+0000","last_fullsized":"2024-04-16T12:57:59.556938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556773+0000","last_change":"2024-04-16T12:57:57.416527+0000","last_active":"2024-04-16T12:57:59.556773+0000","last_peered":"2024-04-16T12:57:59.556773+0000","last_clean":"2024-04-16T12:57:59.556773+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:57:59.556773+0000","last_undegraded":"2024-04-16T12:57:59.556773+0000","last_fullsized":"2024-04-16T12:57:59.556773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408749+0000","last_change":"2024-04-16T12:57:58.422936+0000","last_active":"2024-04-16T12:57:59.408749+0000","last_peered":"2024-04-16T12:57:59.408749+0000","last_clean":"2024-04-16T12:57:59.408749+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:57:59.408749+0000","last_undegraded":"2024-04-16T12:57:59.408749+0000","last_fullsized":"2024-04-16T12:57:59.408749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556749+0000","last_change":"2024-04-16T12:57:57.418379+0000","last_active":"2024-04-16T12:57:59.556749+0000","last_peered":"2024-04-16T12:57:59.556749+0000","last_clean":"2024-04-16T12:57:59.556749+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:57:59.556749+0000","last_undegraded":"2024-04-16T12:57:59.556749+0000","last_fullsized":"2024-04-16T12:57:59.556749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409385+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:59.409385+0000","last_peered":"2024-04-16T12:57:59.409385+0000","last_clean":"2024-04-16T12:57:59.409385+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:59.409385+0000","last_undegraded":"2024-04-16T12:57:59.409385+0000","last_fullsized":"2024-04-16T12:57:59.409385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:08.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:08.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.288+0000 7f2880e74640 1 Processor -- start 2024-04-16T12:58:08.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.288+0000 7f2880e74640 1 -- start start 2024-04-16T12:58:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f2880e74640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 0x7f287c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f2880e74640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f287c14c2d0 con 0x7f287c06d330 2024-04-16T12:58:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f2880e74640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f287c06e9b0 con 0x7f287c0b57f0 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f2880e74640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f287c0b7210 con 0x7f287c06e5d0 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f287ad9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f287c06d330 0x7f287c14bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42990/0 (socket says 172.21.15.106:42990) 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f287ad9d640 1 -- 172.21.15.106:0/4095272585 learned_addr learned my addr 172.21.15.106:0/4095272585 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f287a59c640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 0x7f287c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715678937 0 0) 0x7f287c14c2d0 con 0x7f287c06d330 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.289+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2868003520 con 0x7f287c06d330 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67702387 0 0) 0x7f287c06e9b0 con 0x7f287c0b57f0 2024-04-16T12:58:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f287c14c2d0 con 0x7f287c0b57f0 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2989118209 0 0) 0x7f2868003520 con 0x7f287c06d330 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 msgr2=0x7f287c0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 0x7f287c0b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 >> v1:172.21.15.171:6789/0 conn(0x7f287c0b57f0 legacy=0x7f287c14b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c06db60 con 0x7f287c06d330 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f28740019f0 con 0x7f287c06d330 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 >> v1:172.21.15.106:6789/0 conn(0x7f287c06d330 legacy=0x7f287c14bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2868003b70 0x7f2868003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f2868004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 0x7f2868005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f287c0b7210 con 0x7f2868004800 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f286800bb80 con 0x7f2868003b70 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f286800bd80 con 0x7f287c06e5d0 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2871d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f2868004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f287a59c640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2868003b70 0x7f2868003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f287ad9d640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 0x7f2868005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2871d9b640 1 -- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 msgr2=0x7f2868005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2871d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c06e5d0 0x7f2868005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2871d9b640 1 -- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2868003b70 msgr2=0x7f2868003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2871d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2868003b70 0x7f2868003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.290+0000 7f2871d9b640 1 -- 172.21.15.106:0/4095272585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2868003520 con 0x7f2868004800 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.291+0000 7f2871d9b640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f2868004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f28640018d0 tx=0x7f2868005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e48380995d469 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.291+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2864037070 con 0x7f2868004800 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.291+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28640052d0 con 0x7f2868004800 2024-04-16T12:58:08.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.291+0000 7f2879d9b640 1 -- 172.21.15.106:0/4095272585 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28640014f0 con 0x7f2868004800 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.291+0000 7f2880e74640 1 -- 172.21.15.106:0/4095272585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 msgr2=0x7f2868004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.291+0000 7f2880e74640 1 --2- 172.21.15.106:0/4095272585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f2868004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f28640018d0 tx=0x7f2868005830 comp rx=0 tx=0).stop 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.291+0000 7f287ad9d640 1 -- 172.21.15.106:0/4095272585 reap_dead start 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.292+0000 7f2880e74640 1 -- 172.21.15.106:0/4095272585 shutdown_connections 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.292+0000 7f2880e74640 1 -- 172.21.15.106:0/4095272585 >> 172.21.15.106:0/4095272585 conn(0x7f287c0bb4e0 msgr2=0x7f287c0bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.292+0000 7f2880e74640 1 -- 172.21.15.106:0/4095272585 shutdown_connections 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.292+0000 7f2880e74640 1 -- 172.21.15.106:0/4095272585 wait complete. 2024-04-16T12:58:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 Processor -- start 2024-04-16T12:58:08.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 -- start start 2024-04-16T12:58:08.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f287c1d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c1d26e0 0x7f287c1dd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287c1dda50 0x7f287c1e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f287c06d7e0 con 0x7f2868004800 2024-04-16T12:58:08.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f287c072490 con 0x7f287c1dda50 2024-04-16T12:58:08.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.293+0000 7f2880e74640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f287c0b23c0 con 0x7f287c1d26e0 2024-04-16T12:58:08.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f287c1d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f287c1d1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38880/0 (socket says 172.21.15.106:38880) 2024-04-16T12:58:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 -- 172.21.15.106:0/2506190954 learned_addr learned my addr 172.21.15.106:0/2506190954 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287ad9d640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287c1dda50 0x7f287c1e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 -- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c1d26e0 msgr2=0x7f287c1dd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c1d26e0 0x7f287c1dd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 -- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287c1dda50 msgr2=0x7f287c1e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287c1dda50 0x7f287c1e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 -- 172.21.15.106:0/2506190954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c1d2ea0 con 0x7f2868004800 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287ad9d640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287c1dda50 0x7f287c1e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f287a59c640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f287c1d1b40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f286c0119a0 tx=0x7f286c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f28737fe640 1 -- 172.21.15.106:0/2506190954 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c00faf0 con 0x7f2868004800 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f28737fe640 1 -- 172.21.15.106:0/2506190954 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f286c00fc90 con 0x7f2868004800 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f28737fe640 1 -- 172.21.15.106:0/2506190954 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c014440 con 0x7f2868004800 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287c1d1420 con 0x7f2868004800 2024-04-16T12:58:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.294+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287c147960 con 0x7f2868004800 2024-04-16T12:58:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.295+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287c068a90 con 0x7f2868004800 2024-04-16T12:58:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.296+0000 7f28737fe640 1 -- 172.21.15.106:0/2506190954 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f286c012040 con 0x7f2868004800 2024-04-16T12:58:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.296+0000 7f28737fe640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f285c06c8f0 0x7f285c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.296+0000 7f2871d9b640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f285c06c8f0 0x7f285c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.296+0000 7f28737fe640 1 -- 172.21.15.106:0/2506190954 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f286c08c130 con 0x7f2868004800 2024-04-16T12:58:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.297+0000 7f2871d9b640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f285c06c8f0 0x7f285c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2864034000 tx=0x7f2864009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.301+0000 7f28737fe640 1 -- 172.21.15.106:0/2506190954 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f286c019030 con 0x7f2868004800 2024-04-16T12:58:08.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.472+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f287c0b6320 con 0x7f285c06c8f0 2024-04-16T12:58:08.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.478+0000 7f28737fe640 1 -- 172.21.15.106:0/2506190954 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f287c0b6320 con 0x7f285c06c8f0 2024-04-16T12:58:08.482 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:08.484 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:08.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f285c06c8f0 msgr2=0x7f285c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f285c06c8f0 0x7f285c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2864034000 tx=0x7f2864009030 comp rx=0 tx=0).stop 2024-04-16T12:58:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 msgr2=0x7f287c1d1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f287c1d1b40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f286c0119a0 tx=0x7f286c011e60 comp rx=0 tx=0).stop 2024-04-16T12:58:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 shutdown_connections 2024-04-16T12:58:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f285c06c8f0 0x7f285c06edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287c1dda50 0x7f287c1e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287c1d26e0 0x7f287c1dd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 --2- 172.21.15.106:0/2506190954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2868004800 0x7f287c1d1b40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.480+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 >> 172.21.15.106:0/2506190954 conn(0x7f287c0bb4e0 msgr2=0x7f287c14a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:08.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.481+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 shutdown_connections 2024-04-16T12:58:08.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.481+0000 7f2880e74640 1 -- 172.21.15.106:0/2506190954 wait complete. 2024-04-16T12:58:08.493 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-04-16T12:58:08.174896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.769574"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557061+0000","last_change":"2024-04-16T12:57:58.417066+0000","last_active":"2024-04-16T12:57:59.557061+0000","last_peered":"2024-04-16T12:57:59.557061+0000","last_clean":"2024-04-16T12:57:59.557061+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:57:59.557061+0000","last_undegraded":"2024-04-16T12:57:59.557061+0000","last_fullsized":"2024-04-16T12:57:59.557061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:40.783094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557293+0000","last_change":"2024-04-16T12:57:58.414223+0000","last_active":"2024-04-16T12:57:59.557293+0000","last_peered":"2024-04-16T12:57:59.557293+0000","last_clean":"2024-04-16T12:57:59.557293+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:57:59.557293+0000","last_undegraded":"2024-04-16T12:57:59.557293+0000","last_fullsized":"2024-04-16T12:57:59.557293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:04.064696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408863+0000","last_change":"2024-04-16T12:57:58.429706+0000","last_active":"2024-04-16T12:57:59.408863+0000","last_peered":"2024-04-16T12:57:59.408863+0000","last_clean":"2024-04-16T12:57:59.408863+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:57:59.408863+0000","last_undegraded":"2024-04-16T12:57:59.408863+0000","last_fullsized":"2024-04-16T12:57:59.408863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410150+0000","last_change":"2024-04-16T12:57:58.432119+0000","last_active":"2024-04-16T12:57:59.410150+0000","last_peered":"2024-04-16T12:57:59.410150+0000","last_clean":"2024-04-16T12:57:59.410150+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:57:59.410150+0000","last_undegraded":"2024-04-16T12:57:59.410150+0000","last_fullsized":"2024-04-16T12:57:59.410150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557573+0000","last_change":"2024-04-16T12:57:58.415012+0000","last_active":"2024-04-16T12:57:59.557573+0000","last_peered":"2024-04-16T12:57:59.557573+0000","last_clean":"2024-04-16T12:57:59.557573+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:57:59.557573+0000","last_undegraded":"2024-04-16T12:57:59.557573+0000","last_fullsized":"2024-04-16T12:57:59.557573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:02.447913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556831+0000","last_change":"2024-04-16T12:57:58.423617+0000","last_active":"2024-04-16T12:57:59.556831+0000","last_peered":"2024-04-16T12:57:59.556831+0000","last_clean":"2024-04-16T12:57:59.556831+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:57:59.556831+0000","last_undegraded":"2024-04-16T12:57:59.556831+0000","last_fullsized":"2024-04-16T12:57:59.556831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409523+0000","last_change":"2024-04-16T12:57:58.421176+0000","last_active":"2024-04-16T12:57:59.409523+0000","last_peered":"2024-04-16T12:57:59.409523+0000","last_clean":"2024-04-16T12:57:59.409523+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:57:59.409523+0000","last_undegraded":"2024-04-16T12:57:59.409523+0000","last_fullsized":"2024-04-16T12:57:59.409523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408717+0000","last_change":"2024-04-16T12:57:58.420336+0000","last_active":"2024-04-16T12:57:59.408717+0000","last_peered":"2024-04-16T12:57:59.408717+0000","last_clean":"2024-04-16T12:57:59.408717+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:57:59.408717+0000","last_undegraded":"2024-04-16T12:57:59.408717+0000","last_fullsized":"2024-04-16T12:57:59.408717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557536+0000","last_change":"2024-04-16T12:57:58.427221+0000","last_active":"2024-04-16T12:57:59.557536+0000","last_peered":"2024-04-16T12:57:59.557536+0000","last_clean":"2024-04-16T12:57:59.557536+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:57:59.557536+0000","last_undegraded":"2024-04-16T12:57:59.557536+0000","last_fullsized":"2024-04-16T12:57:59.557536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410349+0000","last_change":"2024-04-16T12:57:58.414532+0000","last_active":"2024-04-16T12:57:59.410349+0000","last_peered":"2024-04-16T12:57:59.410349+0000","last_clean":"2024-04-16T12:57:59.410349+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:57:59.410349+0000","last_undegraded":"2024-04-16T12:57:59.410349+0000","last_fullsized":"2024-04-16T12:57:59.410349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:33.604830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409656+0000","last_change":"2024-04-16T12:57:58.419590+0000","last_active":"2024-04-16T12:57:59.409656+0000","last_peered":"2024-04-16T12:57:59.409656+0000","last_clean":"2024-04-16T12:57:59.409656+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:57:59.409656+0000","last_undegraded":"2024-04-16T12:57:59.409656+0000","last_fullsized":"2024-04-16T12:57:59.409656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408763+0000","last_change":"2024-04-16T12:57:58.420968+0000","last_active":"2024-04-16T12:57:59.408763+0000","last_peered":"2024-04-16T12:57:59.408763+0000","last_clean":"2024-04-16T12:57:59.408763+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:57:59.408763+0000","last_undegraded":"2024-04-16T12:57:59.408763+0000","last_fullsized":"2024-04-16T12:57:59.408763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557659+0000","last_change":"2024-04-16T12:57:58.424597+0000","last_active":"2024-04-16T12:57:59.557659+0000","last_peered":"2024-04-16T12:57:59.557659+0000","last_clean":"2024-04-16T12:57:59.557659+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:57:59.557659+0000","last_undegraded":"2024-04-16T12:57:59.557659+0000","last_fullsized":"2024-04-16T12:57:59.557659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:58.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556986+0000","last_change":"2024-04-16T12:57:58.411816+0000","last_active":"2024-04-16T12:57:59.556986+0000","last_peered":"2024-04-16T12:57:59.556986+0000","last_clean":"2024-04-16T12:57:59.556986+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:57:59.556986+0000","last_undegraded":"2024-04-16T12:57:59.556986+0000","last_fullsized":"2024-04-16T12:57:59.556986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408901+0000","last_change":"2024-04-16T12:57:58.419271+0000","last_active":"2024-04-16T12:57:59.408901+0000","last_peered":"2024-04-16T12:57:59.408901+0000","last_clean":"2024-04-16T12:57:59.408901+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:57:59.408901+0000","last_undegraded":"2024-04-16T12:57:59.408901+0000","last_fullsized":"2024-04-16T12:57:59.408901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409323+0000","last_change":"2024-04-16T12:57:58.421606+0000","last_active":"2024-04-16T12:57:59.409323+0000","last_peered":"2024-04-16T12:57:59.409323+0000","last_clean":"2024-04-16T12:57:59.409323+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:57:59.409323+0000","last_undegraded":"2024-04-16T12:57:59.409323+0000","last_fullsized":"2024-04-16T12:57:59.409323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409307+0000","last_change":"2024-04-16T12:57:58.421726+0000","last_active":"2024-04-16T12:57:59.409307+0000","last_peered":"2024-04-16T12:57:59.409307+0000","last_clean":"2024-04-16T12:57:59.409307+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:57:59.409307+0000","last_undegraded":"2024-04-16T12:57:59.409307+0000","last_fullsized":"2024-04-16T12:57:59.409307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557302+0000","last_change":"2024-04-16T12:57:58.417403+0000","last_active":"2024-04-16T12:57:59.557302+0000","last_peered":"2024-04-16T12:57:59.557302+0000","last_clean":"2024-04-16T12:57:59.557302+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:57:59.557302+0000","last_undegraded":"2024-04-16T12:57:59.557302+0000","last_fullsized":"2024-04-16T12:57:59.557302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:24.189968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556932+0000","last_change":"2024-04-16T12:57:58.423377+0000","last_active":"2024-04-16T12:57:59.556932+0000","last_peered":"2024-04-16T12:57:59.556932+0000","last_clean":"2024-04-16T12:57:59.556932+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:57:59.556932+0000","last_undegraded":"2024-04-16T12:57:59.556932+0000","last_fullsized":"2024-04-16T12:57:59.556932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557686+0000","last_change":"2024-04-16T12:57:58.422790+0000","last_active":"2024-04-16T12:57:59.557686+0000","last_peered":"2024-04-16T12:57:59.557686+0000","last_clean":"2024-04-16T12:57:59.557686+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:57:59.557686+0000","last_undegraded":"2024-04-16T12:57:59.557686+0000","last_fullsized":"2024-04-16T12:57:59.557686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:04.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557897+0000","last_change":"2024-04-16T12:57:58.432630+0000","last_active":"2024-04-16T12:57:59.557897+0000","last_peered":"2024-04-16T12:57:59.557897+0000","last_clean":"2024-04-16T12:57:59.557897+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:57:59.557897+0000","last_undegraded":"2024-04-16T12:57:59.557897+0000","last_fullsized":"2024-04-16T12:57:59.557897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557157+0000","last_change":"2024-04-16T12:57:58.428165+0000","last_active":"2024-04-16T12:57:59.557157+0000","last_peered":"2024-04-16T12:57:59.557157+0000","last_clean":"2024-04-16T12:57:59.557157+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:57:59.557157+0000","last_undegraded":"2024-04-16T12:57:59.557157+0000","last_fullsized":"2024-04-16T12:57:59.557157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556657+0000","last_change":"2024-04-16T12:57:58.419322+0000","last_active":"2024-04-16T12:57:59.556657+0000","last_peered":"2024-04-16T12:57:59.556657+0000","last_clean":"2024-04-16T12:57:59.556657+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:57:59.556657+0000","last_undegraded":"2024-04-16T12:57:59.556657+0000","last_fullsized":"2024-04-16T12:57:59.556657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408594+0000","last_change":"2024-04-16T12:57:58.425245+0000","last_active":"2024-04-16T12:57:59.408594+0000","last_peered":"2024-04-16T12:57:59.408594+0000","last_clean":"2024-04-16T12:57:59.408594+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:57:59.408594+0000","last_undegraded":"2024-04-16T12:57:59.408594+0000","last_fullsized":"2024-04-16T12:57:59.408594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410326+0000","last_change":"2024-04-16T12:57:58.422256+0000","last_active":"2024-04-16T12:57:59.410326+0000","last_peered":"2024-04-16T12:57:59.410326+0000","last_clean":"2024-04-16T12:57:59.410326+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:57:59.410326+0000","last_undegraded":"2024-04-16T12:57:59.410326+0000","last_fullsized":"2024-04-16T12:57:59.410326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557449+0000","last_change":"2024-04-16T12:57:58.421697+0000","last_active":"2024-04-16T12:57:59.557449+0000","last_peered":"2024-04-16T12:57:59.557449+0000","last_clean":"2024-04-16T12:57:59.557449+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:57:59.557449+0000","last_undegraded":"2024-04-16T12:57:59.557449+0000","last_fullsized":"2024-04-16T12:57:59.557449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:39.008329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410430+0000","last_change":"2024-04-16T12:57:58.429064+0000","last_active":"2024-04-16T12:57:59.410430+0000","last_peered":"2024-04-16T12:57:59.410430+0000","last_clean":"2024-04-16T12:57:59.410430+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:57:59.410430+0000","last_undegraded":"2024-04-16T12:57:59.410430+0000","last_fullsized":"2024-04-16T12:57:59.410430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408814+0000","last_change":"2024-04-16T12:57:58.420144+0000","last_active":"2024-04-16T12:57:59.408814+0000","last_peered":"2024-04-16T12:57:59.408814+0000","last_clean":"2024-04-16T12:57:59.408814+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:57:59.408814+0000","last_undegraded":"2024-04-16T12:57:59.408814+0000","last_fullsized":"2024-04-16T12:57:59.408814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557851+0000","last_change":"2024-04-16T12:57:58.428551+0000","last_active":"2024-04-16T12:57:59.557851+0000","last_peered":"2024-04-16T12:57:59.557851+0000","last_clean":"2024-04-16T12:57:59.557851+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:57:59.557851+0000","last_undegraded":"2024-04-16T12:57:59.557851+0000","last_fullsized":"2024-04-16T12:57:59.557851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408962+0000","last_change":"2024-04-16T12:57:58.419164+0000","last_active":"2024-04-16T12:57:59.408962+0000","last_peered":"2024-04-16T12:57:59.408962+0000","last_clean":"2024-04-16T12:57:59.408962+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:57:59.408962+0000","last_undegraded":"2024-04-16T12:57:59.408962+0000","last_fullsized":"2024-04-16T12:57:59.408962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557022+0000","last_change":"2024-04-16T12:57:58.417480+0000","last_active":"2024-04-16T12:57:59.557022+0000","last_peered":"2024-04-16T12:57:59.557022+0000","last_clean":"2024-04-16T12:57:59.557022+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:57:59.557022+0000","last_undegraded":"2024-04-16T12:57:59.557022+0000","last_fullsized":"2024-04-16T12:57:59.557022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:55:29.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408880+0000","last_change":"2024-04-16T12:57:58.429121+0000","last_active":"2024-04-16T12:57:59.408880+0000","last_peered":"2024-04-16T12:57:59.408880+0000","last_clean":"2024-04-16T12:57:59.408880+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:57:59.408880+0000","last_undegraded":"2024-04-16T12:57:59.408880+0000","last_fullsized":"2024-04-16T12:57:59.408880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.529728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557103+0000","last_change":"2024-04-16T12:57:58.425769+0000","last_active":"2024-04-16T12:57:59.557103+0000","last_peered":"2024-04-16T12:57:59.557103+0000","last_clean":"2024-04-16T12:57:59.557103+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:57:59.557103+0000","last_undegraded":"2024-04-16T12:57:59.557103+0000","last_fullsized":"2024-04-16T12:57:59.557103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557168+0000","last_change":"2024-04-16T12:57:57.419875+0000","last_active":"2024-04-16T12:57:59.557168+0000","last_peered":"2024-04-16T12:57:59.557168+0000","last_clean":"2024-04-16T12:57:59.557168+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:57:59.557168+0000","last_undegraded":"2024-04-16T12:57:59.557168+0000","last_fullsized":"2024-04-16T12:57:59.557168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556949+0000","last_change":"2024-04-16T12:57:58.429507+0000","last_active":"2024-04-16T12:57:59.556949+0000","last_peered":"2024-04-16T12:57:59.556949+0000","last_clean":"2024-04-16T12:57:59.556949+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:57:59.556949+0000","last_undegraded":"2024-04-16T12:57:59.556949+0000","last_fullsized":"2024-04-16T12:57:59.556949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:48.320225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557195+0000","last_change":"2024-04-16T12:57:57.409560+0000","last_active":"2024-04-16T12:57:59.557195+0000","last_peered":"2024-04-16T12:57:59.557195+0000","last_clean":"2024-04-16T12:57:59.557195+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:57:59.557195+0000","last_undegraded":"2024-04-16T12:57:59.557195+0000","last_fullsized":"2024-04-16T12:57:59.557195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557564+0000","last_change":"2024-04-16T12:57:58.430344+0000","last_active":"2024-04-16T12:57:59.557564+0000","last_peered":"2024-04-16T12:57:59.557564+0000","last_clean":"2024-04-16T12:57:59.557564+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:57:59.557564+0000","last_undegraded":"2024-04-16T12:57:59.557564+0000","last_fullsized":"2024-04-16T12:57:59.557564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557003+0000","last_change":"2024-04-16T12:57:57.421388+0000","last_active":"2024-04-16T12:57:59.557003+0000","last_peered":"2024-04-16T12:57:59.557003+0000","last_clean":"2024-04-16T12:57:59.557003+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:57:59.557003+0000","last_undegraded":"2024-04-16T12:57:59.557003+0000","last_fullsized":"2024-04-16T12:57:59.557003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:23.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410459+0000","last_change":"2024-04-16T12:57:58.427164+0000","last_active":"2024-04-16T12:57:59.410459+0000","last_peered":"2024-04-16T12:57:59.410459+0000","last_clean":"2024-04-16T12:57:59.410459+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:57:59.410459+0000","last_undegraded":"2024-04-16T12:57:59.410459+0000","last_fullsized":"2024-04-16T12:57:59.410459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557793+0000","last_change":"2024-04-16T12:57:57.419891+0000","last_active":"2024-04-16T12:57:59.557793+0000","last_peered":"2024-04-16T12:57:59.557793+0000","last_clean":"2024-04-16T12:57:59.557793+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:57:59.557793+0000","last_undegraded":"2024-04-16T12:57:59.557793+0000","last_fullsized":"2024-04-16T12:57:59.557793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:48.386771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409438+0000","last_change":"2024-04-16T12:57:58.428187+0000","last_active":"2024-04-16T12:57:59.409438+0000","last_peered":"2024-04-16T12:57:59.409438+0000","last_clean":"2024-04-16T12:57:59.409438+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:57:59.409438+0000","last_undegraded":"2024-04-16T12:57:59.409438+0000","last_fullsized":"2024-04-16T12:57:59.409438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557927+0000","last_change":"2024-04-16T12:57:57.419136+0000","last_active":"2024-04-16T12:57:59.557927+0000","last_peered":"2024-04-16T12:57:59.557927+0000","last_clean":"2024-04-16T12:57:59.557927+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:57:59.557927+0000","last_undegraded":"2024-04-16T12:57:59.557927+0000","last_fullsized":"2024-04-16T12:57:59.557927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408786+0000","last_change":"2024-04-16T12:57:58.428624+0000","last_active":"2024-04-16T12:57:59.408786+0000","last_peered":"2024-04-16T12:57:59.408786+0000","last_clean":"2024-04-16T12:57:59.408786+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:57:59.408786+0000","last_undegraded":"2024-04-16T12:57:59.408786+0000","last_fullsized":"2024-04-16T12:57:59.408786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557287+0000","last_change":"2024-04-16T12:57:57.418607+0000","last_active":"2024-04-16T12:57:59.557287+0000","last_peered":"2024-04-16T12:57:59.557287+0000","last_clean":"2024-04-16T12:57:59.557287+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:57:59.557287+0000","last_undegraded":"2024-04-16T12:57:59.557287+0000","last_fullsized":"2024-04-16T12:57:59.557287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:17.248246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556971+0000","last_change":"2024-04-16T12:57:58.426553+0000","last_active":"2024-04-16T12:57:59.556971+0000","last_peered":"2024-04-16T12:57:59.556971+0000","last_clean":"2024-04-16T12:57:59.556971+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:57:59.556971+0000","last_undegraded":"2024-04-16T12:57:59.556971+0000","last_fullsized":"2024-04-16T12:57:59.556971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556800+0000","last_change":"2024-04-16T12:57:57.418496+0000","last_active":"2024-04-16T12:57:59.556800+0000","last_peered":"2024-04-16T12:57:59.556800+0000","last_clean":"2024-04-16T12:57:59.556800+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:57:59.556800+0000","last_undegraded":"2024-04-16T12:57:59.556800+0000","last_fullsized":"2024-04-16T12:57:59.556800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409997+0000","last_change":"2024-04-16T12:57:58.421803+0000","last_active":"2024-04-16T12:57:59.409997+0000","last_peered":"2024-04-16T12:57:59.409997+0000","last_clean":"2024-04-16T12:57:59.409997+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:57:59.409997+0000","last_undegraded":"2024-04-16T12:57:59.409997+0000","last_fullsized":"2024-04-16T12:57:59.409997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557158+0000","last_change":"2024-04-16T12:57:57.417993+0000","last_active":"2024-04-16T12:57:59.557158+0000","last_peered":"2024-04-16T12:57:59.557158+0000","last_clean":"2024-04-16T12:57:59.557158+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:57:59.557158+0000","last_undegraded":"2024-04-16T12:57:59.557158+0000","last_fullsized":"2024-04-16T12:57:59.557158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:27:27.583239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409611+0000","last_change":"2024-04-16T12:57:58.421729+0000","last_active":"2024-04-16T12:57:59.409611+0000","last_peered":"2024-04-16T12:57:59.409611+0000","last_clean":"2024-04-16T12:57:59.409611+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:57:59.409611+0000","last_undegraded":"2024-04-16T12:57:59.409611+0000","last_fullsized":"2024-04-16T12:57:59.409611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556740+0000","last_change":"2024-04-16T12:57:57.419936+0000","last_active":"2024-04-16T12:57:59.556740+0000","last_peered":"2024-04-16T12:57:59.556740+0000","last_clean":"2024-04-16T12:57:59.556740+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:57:59.556740+0000","last_undegraded":"2024-04-16T12:57:59.556740+0000","last_fullsized":"2024-04-16T12:57:59.556740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:09.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556761+0000","last_change":"2024-04-16T12:57:58.423776+0000","last_active":"2024-04-16T12:57:59.556761+0000","last_peered":"2024-04-16T12:57:59.556761+0000","last_clean":"2024-04-16T12:57:59.556761+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:57:59.556761+0000","last_undegraded":"2024-04-16T12:57:59.556761+0000","last_fullsized":"2024-04-16T12:57:59.556761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557282+0000","last_change":"2024-04-16T12:57:57.418768+0000","last_active":"2024-04-16T12:57:59.557282+0000","last_peered":"2024-04-16T12:57:59.557282+0000","last_clean":"2024-04-16T12:57:59.557282+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:57:59.557282+0000","last_undegraded":"2024-04-16T12:57:59.557282+0000","last_fullsized":"2024-04-16T12:57:59.557282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557137+0000","last_change":"2024-04-16T12:57:58.421105+0000","last_active":"2024-04-16T12:57:59.557137+0000","last_peered":"2024-04-16T12:57:59.557137+0000","last_clean":"2024-04-16T12:57:59.557137+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:57:59.557137+0000","last_undegraded":"2024-04-16T12:57:59.557137+0000","last_fullsized":"2024-04-16T12:57:59.557137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408991+0000","last_change":"2024-04-16T12:57:57.416238+0000","last_active":"2024-04-16T12:57:59.408991+0000","last_peered":"2024-04-16T12:57:59.408991+0000","last_clean":"2024-04-16T12:57:59.408991+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:57:59.408991+0000","last_undegraded":"2024-04-16T12:57:59.408991+0000","last_fullsized":"2024-04-16T12:57:59.408991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408608+0000","last_change":"2024-04-16T12:57:58.428014+0000","last_active":"2024-04-16T12:57:59.408608+0000","last_peered":"2024-04-16T12:57:59.408608+0000","last_clean":"2024-04-16T12:57:59.408608+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:57:59.408608+0000","last_undegraded":"2024-04-16T12:57:59.408608+0000","last_fullsized":"2024-04-16T12:57:59.408608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557150+0000","last_change":"2024-04-16T12:57:57.421382+0000","last_active":"2024-04-16T12:57:59.557150+0000","last_peered":"2024-04-16T12:57:59.557150+0000","last_clean":"2024-04-16T12:57:59.557150+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:57:59.557150+0000","last_undegraded":"2024-04-16T12:57:59.557150+0000","last_fullsized":"2024-04-16T12:57:59.557150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:09.260220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410034+0000","last_change":"2024-04-16T12:57:58.417617+0000","last_active":"2024-04-16T12:57:59.410034+0000","last_peered":"2024-04-16T12:57:59.410034+0000","last_clean":"2024-04-16T12:57:59.410034+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:57:59.410034+0000","last_undegraded":"2024-04-16T12:57:59.410034+0000","last_fullsized":"2024-04-16T12:57:59.410034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.558015+0000","last_change":"2024-04-16T12:57:57.419094+0000","last_active":"2024-04-16T12:57:59.558015+0000","last_peered":"2024-04-16T12:57:59.558015+0000","last_clean":"2024-04-16T12:57:59.558015+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:57:59.558015+0000","last_undegraded":"2024-04-16T12:57:59.558015+0000","last_fullsized":"2024-04-16T12:57:59.558015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557010+0000","last_change":"2024-04-16T12:57:58.414688+0000","last_active":"2024-04-16T12:57:59.557010+0000","last_peered":"2024-04-16T12:57:59.557010+0000","last_clean":"2024-04-16T12:57:59.557010+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:57:59.557010+0000","last_undegraded":"2024-04-16T12:57:59.557010+0000","last_fullsized":"2024-04-16T12:57:59.557010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410019+0000","last_change":"2024-04-16T12:57:57.416542+0000","last_active":"2024-04-16T12:57:59.410019+0000","last_peered":"2024-04-16T12:57:59.410019+0000","last_clean":"2024-04-16T12:57:59.410019+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:57:59.410019+0000","last_undegraded":"2024-04-16T12:57:59.410019+0000","last_fullsized":"2024-04-16T12:57:59.410019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409146+0000","last_change":"2024-04-16T12:57:58.429363+0000","last_active":"2024-04-16T12:57:59.409146+0000","last_peered":"2024-04-16T12:57:59.409146+0000","last_clean":"2024-04-16T12:57:59.409146+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:57:59.409146+0000","last_undegraded":"2024-04-16T12:57:59.409146+0000","last_fullsized":"2024-04-16T12:57:59.409146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557034+0000","last_change":"2024-04-16T12:57:57.417272+0000","last_active":"2024-04-16T12:57:59.557034+0000","last_peered":"2024-04-16T12:57:59.557034+0000","last_clean":"2024-04-16T12:57:59.557034+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:57:59.557034+0000","last_undegraded":"2024-04-16T12:57:59.557034+0000","last_fullsized":"2024-04-16T12:57:59.557034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:19.085142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:58.428318+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556658+0000","last_change":"2024-04-16T12:57:57.418665+0000","last_active":"2024-04-16T12:57:59.556658+0000","last_peered":"2024-04-16T12:57:59.556658+0000","last_clean":"2024-04-16T12:57:59.556658+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:57:59.556658+0000","last_undegraded":"2024-04-16T12:57:59.556658+0000","last_fullsized":"2024-04-16T12:57:59.556658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:39.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557740+0000","last_change":"2024-04-16T12:57:58.424884+0000","last_active":"2024-04-16T12:57:59.557740+0000","last_peered":"2024-04-16T12:57:59.557740+0000","last_clean":"2024-04-16T12:57:59.557740+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:57:59.557740+0000","last_undegraded":"2024-04-16T12:57:59.557740+0000","last_fullsized":"2024-04-16T12:57:59.557740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410365+0000","last_change":"2024-04-16T12:57:57.417511+0000","last_active":"2024-04-16T12:57:59.410365+0000","last_peered":"2024-04-16T12:57:59.410365+0000","last_clean":"2024-04-16T12:57:59.410365+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:57:59.410365+0000","last_undegraded":"2024-04-16T12:57:59.410365+0000","last_fullsized":"2024-04-16T12:57:59.410365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409706+0000","last_change":"2024-04-16T12:57:58.431315+0000","last_active":"2024-04-16T12:57:59.409706+0000","last_peered":"2024-04-16T12:57:59.409706+0000","last_clean":"2024-04-16T12:57:59.409706+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:57:59.409706+0000","last_undegraded":"2024-04-16T12:57:59.409706+0000","last_fullsized":"2024-04-16T12:57:59.409706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557710+0000","last_change":"2024-04-16T12:57:57.419368+0000","last_active":"2024-04-16T12:57:59.557710+0000","last_peered":"2024-04-16T12:57:59.557710+0000","last_clean":"2024-04-16T12:57:59.557710+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:57:59.557710+0000","last_undegraded":"2024-04-16T12:57:59.557710+0000","last_fullsized":"2024-04-16T12:57:59.557710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410299+0000","last_change":"2024-04-16T12:57:58.431490+0000","last_active":"2024-04-16T12:57:59.410299+0000","last_peered":"2024-04-16T12:57:59.410299+0000","last_clean":"2024-04-16T12:57:59.410299+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:57:59.410299+0000","last_undegraded":"2024-04-16T12:57:59.410299+0000","last_fullsized":"2024-04-16T12:57:59.410299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557329+0000","last_change":"2024-04-16T12:57:57.418637+0000","last_active":"2024-04-16T12:57:59.557329+0000","last_peered":"2024-04-16T12:57:59.557329+0000","last_clean":"2024-04-16T12:57:59.557329+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:57:59.557329+0000","last_undegraded":"2024-04-16T12:57:59.557329+0000","last_fullsized":"2024-04-16T12:57:59.557329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:49.553356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557676+0000","last_change":"2024-04-16T12:57:58.420291+0000","last_active":"2024-04-16T12:57:59.557676+0000","last_peered":"2024-04-16T12:57:59.557676+0000","last_clean":"2024-04-16T12:57:59.557676+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:57:59.557676+0000","last_undegraded":"2024-04-16T12:57:59.557676+0000","last_fullsized":"2024-04-16T12:57:59.557676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557561+0000","last_change":"2024-04-16T12:57:57.420173+0000","last_active":"2024-04-16T12:57:59.557561+0000","last_peered":"2024-04-16T12:57:59.557561+0000","last_clean":"2024-04-16T12:57:59.557561+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:57:59.557561+0000","last_undegraded":"2024-04-16T12:57:59.557561+0000","last_fullsized":"2024-04-16T12:57:59.557561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:01.440156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556745+0000","last_change":"2024-04-16T12:57:58.428239+0000","last_active":"2024-04-16T12:57:59.556745+0000","last_peered":"2024-04-16T12:57:59.556745+0000","last_clean":"2024-04-16T12:57:59.556745+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:57:59.556745+0000","last_undegraded":"2024-04-16T12:57:59.556745+0000","last_fullsized":"2024-04-16T12:57:59.556745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:18.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557492+0000","last_change":"2024-04-16T12:57:57.416742+0000","last_active":"2024-04-16T12:57:59.557492+0000","last_peered":"2024-04-16T12:57:59.557492+0000","last_clean":"2024-04-16T12:57:59.557492+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:57:59.557492+0000","last_undegraded":"2024-04-16T12:57:59.557492+0000","last_fullsized":"2024-04-16T12:57:59.557492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:28.073205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557717+0000","last_change":"2024-04-16T12:57:58.415256+0000","last_active":"2024-04-16T12:57:59.557717+0000","last_peered":"2024-04-16T12:57:59.557717+0000","last_clean":"2024-04-16T12:57:59.557717+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:57:59.557717+0000","last_undegraded":"2024-04-16T12:57:59.557717+0000","last_fullsized":"2024-04-16T12:57:59.557717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:44.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:57.418163+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556520+0000","last_change":"2024-04-16T12:57:58.422113+0000","last_active":"2024-04-16T12:57:59.556520+0000","last_peered":"2024-04-16T12:57:59.556520+0000","last_clean":"2024-04-16T12:57:59.556520+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:57:59.556520+0000","last_undegraded":"2024-04-16T12:57:59.556520+0000","last_fullsized":"2024-04-16T12:57:59.556520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:50.561113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557093+0000","last_change":"2024-04-16T12:57:57.420836+0000","last_active":"2024-04-16T12:57:59.557093+0000","last_peered":"2024-04-16T12:57:59.557093+0000","last_clean":"2024-04-16T12:57:59.557093+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:57:59.557093+0000","last_undegraded":"2024-04-16T12:57:59.557093+0000","last_fullsized":"2024-04-16T12:57:59.557093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409271+0000","last_change":"2024-04-16T12:57:58.418246+0000","last_active":"2024-04-16T12:57:59.409271+0000","last_peered":"2024-04-16T12:57:59.409271+0000","last_clean":"2024-04-16T12:57:59.409271+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:57:59.409271+0000","last_undegraded":"2024-04-16T12:57:59.409271+0000","last_fullsized":"2024-04-16T12:57:59.409271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408689+0000","last_change":"2024-04-16T12:57:57.415493+0000","last_active":"2024-04-16T12:57:59.408689+0000","last_peered":"2024-04-16T12:57:59.408689+0000","last_clean":"2024-04-16T12:57:59.408689+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:57:59.408689+0000","last_undegraded":"2024-04-16T12:57:59.408689+0000","last_fullsized":"2024-04-16T12:57:59.408689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557558+0000","last_change":"2024-04-16T12:57:58.424345+0000","last_active":"2024-04-16T12:57:59.557558+0000","last_peered":"2024-04-16T12:57:59.557558+0000","last_clean":"2024-04-16T12:57:59.557558+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:57:59.557558+0000","last_undegraded":"2024-04-16T12:57:59.557558+0000","last_fullsized":"2024-04-16T12:57:59.557558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:44.705042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410427+0000","last_change":"2024-04-16T12:57:57.419610+0000","last_active":"2024-04-16T12:57:59.410427+0000","last_peered":"2024-04-16T12:57:59.410427+0000","last_clean":"2024-04-16T12:57:59.410427+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:57:59.410427+0000","last_undegraded":"2024-04-16T12:57:59.410427+0000","last_fullsized":"2024-04-16T12:57:59.410427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:00:29.563675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409731+0000","last_change":"2024-04-16T12:57:58.428160+0000","last_active":"2024-04-16T12:57:59.409731+0000","last_peered":"2024-04-16T12:57:59.409731+0000","last_clean":"2024-04-16T12:57:59.409731+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:57:59.409731+0000","last_undegraded":"2024-04-16T12:57:59.409731+0000","last_fullsized":"2024-04-16T12:57:59.409731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557366+0000","last_change":"2024-04-16T12:57:57.415967+0000","last_active":"2024-04-16T12:57:59.557366+0000","last_peered":"2024-04-16T12:57:59.557366+0000","last_clean":"2024-04-16T12:57:59.557366+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:57:59.557366+0000","last_undegraded":"2024-04-16T12:57:59.557366+0000","last_fullsized":"2024-04-16T12:57:59.557366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556899+0000","last_change":"2024-04-16T12:57:58.419642+0000","last_active":"2024-04-16T12:57:59.556899+0000","last_peered":"2024-04-16T12:57:59.556899+0000","last_clean":"2024-04-16T12:57:59.556899+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:57:59.556899+0000","last_undegraded":"2024-04-16T12:57:59.556899+0000","last_fullsized":"2024-04-16T12:57:59.556899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410370+0000","last_change":"2024-04-16T12:57:57.416214+0000","last_active":"2024-04-16T12:57:59.410370+0000","last_peered":"2024-04-16T12:57:59.410370+0000","last_clean":"2024-04-16T12:57:59.410370+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:57:59.410370+0000","last_undegraded":"2024-04-16T12:57:59.410370+0000","last_fullsized":"2024-04-16T12:57:59.410370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557237+0000","last_change":"2024-04-16T12:57:58.420763+0000","last_active":"2024-04-16T12:57:59.557237+0000","last_peered":"2024-04-16T12:57:59.557237+0000","last_clean":"2024-04-16T12:57:59.557237+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:57:59.557237+0000","last_undegraded":"2024-04-16T12:57:59.557237+0000","last_fullsized":"2024-04-16T12:57:59.557237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557670+0000","last_change":"2024-04-16T12:57:57.413675+0000","last_active":"2024-04-16T12:57:59.557670+0000","last_peered":"2024-04-16T12:57:59.557670+0000","last_clean":"2024-04-16T12:57:59.557670+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:57:59.557670+0000","last_undegraded":"2024-04-16T12:57:59.557670+0000","last_fullsized":"2024-04-16T12:57:59.557670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557738+0000","last_change":"2024-04-16T12:57:58.417795+0000","last_active":"2024-04-16T12:57:59.557738+0000","last_peered":"2024-04-16T12:57:59.557738+0000","last_clean":"2024-04-16T12:57:59.557738+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:57:59.557738+0000","last_undegraded":"2024-04-16T12:57:59.557738+0000","last_fullsized":"2024-04-16T12:57:59.557738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410124+0000","last_change":"2024-04-16T12:57:57.418446+0000","last_active":"2024-04-16T12:57:59.410124+0000","last_peered":"2024-04-16T12:57:59.410124+0000","last_clean":"2024-04-16T12:57:59.410124+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:57:59.410124+0000","last_undegraded":"2024-04-16T12:57:59.410124+0000","last_fullsized":"2024-04-16T12:57:59.410124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556666+0000","last_change":"2024-04-16T12:57:58.415348+0000","last_active":"2024-04-16T12:57:59.556666+0000","last_peered":"2024-04-16T12:57:59.556666+0000","last_clean":"2024-04-16T12:57:59.556666+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:57:59.556666+0000","last_undegraded":"2024-04-16T12:57:59.556666+0000","last_fullsized":"2024-04-16T12:57:59.556666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557259+0000","last_change":"2024-04-16T12:57:57.424470+0000","last_active":"2024-04-16T12:57:59.557259+0000","last_peered":"2024-04-16T12:57:59.557259+0000","last_clean":"2024-04-16T12:57:59.557259+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:57:59.557259+0000","last_undegraded":"2024-04-16T12:57:59.557259+0000","last_fullsized":"2024-04-16T12:57:59.557259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:43.697285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556938+0000","last_change":"2024-04-16T12:57:58.428240+0000","last_active":"2024-04-16T12:57:59.556938+0000","last_peered":"2024-04-16T12:57:59.556938+0000","last_clean":"2024-04-16T12:57:59.556938+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:57:59.556938+0000","last_undegraded":"2024-04-16T12:57:59.556938+0000","last_fullsized":"2024-04-16T12:57:59.556938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556773+0000","last_change":"2024-04-16T12:57:57.416527+0000","last_active":"2024-04-16T12:57:59.556773+0000","last_peered":"2024-04-16T12:57:59.556773+0000","last_clean":"2024-04-16T12:57:59.556773+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:57:59.556773+0000","last_undegraded":"2024-04-16T12:57:59.556773+0000","last_fullsized":"2024-04-16T12:57:59.556773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408749+0000","last_change":"2024-04-16T12:57:58.422936+0000","last_active":"2024-04-16T12:57:59.408749+0000","last_peered":"2024-04-16T12:57:59.408749+0000","last_clean":"2024-04-16T12:57:59.408749+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:57:59.408749+0000","last_undegraded":"2024-04-16T12:57:59.408749+0000","last_fullsized":"2024-04-16T12:57:59.408749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556749+0000","last_change":"2024-04-16T12:57:57.418379+0000","last_active":"2024-04-16T12:57:59.556749+0000","last_peered":"2024-04-16T12:57:59.556749+0000","last_clean":"2024-04-16T12:57:59.556749+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:57:59.556749+0000","last_undegraded":"2024-04-16T12:57:59.556749+0000","last_fullsized":"2024-04-16T12:57:59.556749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409385+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:59.409385+0000","last_peered":"2024-04-16T12:57:59.409385+0000","last_clean":"2024-04-16T12:57:59.409385+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:59.409385+0000","last_undegraded":"2024-04-16T12:57:59.409385+0000","last_fullsized":"2024-04-16T12:57:59.409385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:08.497 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T12:58:08.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:08.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.635+0000 7f43fe269640 1 Processor -- start 2024-04-16T12:58:08.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.635+0000 7f43fe269640 1 -- start start 2024-04-16T12:58:08.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fe269640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f809fb60 0x7f43f80b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fe269640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f8067db0 con 0x7f43f80b0ac0 2024-04-16T12:58:08.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fe269640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f80b5b10 con 0x7f43f80679d0 2024-04-16T12:58:08.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fe269640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43f80b45f0 con 0x7f43f809fb60 2024-04-16T12:58:08.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43f77fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f43f80b0ac0 0x7f43f81505a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42996/0 (socket says 172.21.15.106:42996) 2024-04-16T12:58:08.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43f77fe640 1 -- 172.21.15.106:0/742616580 learned_addr learned my addr 172.21.15.106:0/742616580 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:08.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fc806640 1 --2- 172.21.15.106:0/742616580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f809fb60 0x7f43f80b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43f6ffd640 1 -- 172.21.15.106:0/742616580 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2856110359 0 0) 0x7f43f8067db0 con 0x7f43f80b0ac0 2024-04-16T12:58:08.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43f6ffd640 1 -- 172.21.15.106:0/742616580 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e0003520 con 0x7f43f80b0ac0 2024-04-16T12:58:08.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43f6ffd640 1 -- 172.21.15.106:0/742616580 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754526345 0 0) 0x7f43f80b5b10 con 0x7f43f80679d0 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fc806640 1 -- 172.21.15.106:0/742616580 >> v1:172.21.15.171:6789/0 conn(0x7f43f80679d0 legacy=0x7f43f8144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fc806640 1 -- 172.21.15.106:0/742616580 >> v1:172.21.15.106:6789/0 conn(0x7f43f80b0ac0 legacy=0x7f43f81505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.636+0000 7f43fc806640 1 -- 172.21.15.106:0/742616580 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f80b5df0 con 0x7f43f809fb60 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.637+0000 7f43fc806640 1 --2- 172.21.15.106:0/742616580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f809fb60 0x7f43f80b4a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009dc0 tx=0x7f43f002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1710f28c573721e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.637+0000 7f43f6ffd640 1 -- 172.21.15.106:0/742616580 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0039070 con 0x7f43f809fb60 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.637+0000 7f43f6ffd640 1 -- 172.21.15.106:0/742616580 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f002ccd0 con 0x7f43f809fb60 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.637+0000 7f43f6ffd640 1 -- 172.21.15.106:0/742616580 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0034640 con 0x7f43f809fb60 2024-04-16T12:58:08.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.638+0000 7f43fe269640 1 -- 172.21.15.106:0/742616580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f809fb60 msgr2=0x7f43f80b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.638+0000 7f43fe269640 1 --2- 172.21.15.106:0/742616580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f809fb60 0x7f43f80b4a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009dc0 tx=0x7f43f002bf20 comp rx=0 tx=0).stop 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.638+0000 7f43fe269640 1 -- 172.21.15.106:0/742616580 shutdown_connections 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.638+0000 7f43fe269640 1 --2- 172.21.15.106:0/742616580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f809fb60 0x7f43f80b4a80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.638+0000 7f43fe269640 1 -- 172.21.15.106:0/742616580 >> 172.21.15.106:0/742616580 conn(0x7f43f80b9ca0 msgr2=0x7f43f80ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.638+0000 7f43fe269640 1 -- 172.21.15.106:0/742616580 shutdown_connections 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.638+0000 7f43fe269640 1 -- 172.21.15.106:0/742616580 wait complete. 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.639+0000 7f43fe269640 1 Processor -- start 2024-04-16T12:58:08.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.639+0000 7f43fe269640 1 -- start start 2024-04-16T12:58:08.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f80679d0 0x7f43f81cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f809fb60 0x7f43f81d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f80b0ac0 0x7f43f81dd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f43f81455d0 con 0x7f43f80679d0 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43f8145450 con 0x7f43f809fb60 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43f8145750 con 0x7f43f80b0ac0 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f80679d0 0x7f43f81cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f80679d0 0x7f43f81cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38882/0 (socket says 172.21.15.106:38882) 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 -- 172.21.15.106:0/3478492213 learned_addr learned my addr 172.21.15.106:0/3478492213 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f77fe640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f809fb60 0x7f43f81d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fc806640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f80b0ac0 0x7f43f81dd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 -- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f80b0ac0 msgr2=0x7f43f81dd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f80b0ac0 0x7f43f81dd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 -- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f809fb60 msgr2=0x7f43f81d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f809fb60 0x7f43f81d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 -- 172.21.15.106:0/3478492213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f81d0c20 con 0x7f43f80679d0 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f7fff640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f80679d0 0x7f43f81cf050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43e800c4e0 tx=0x7f43e800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f4ff9640 1 -- 172.21.15.106:0/3478492213 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8017070 con 0x7f43f80679d0 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f4ff9640 1 -- 172.21.15.106:0/3478492213 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e80035f0 con 0x7f43f80679d0 2024-04-16T12:58:08.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43f4ff9640 1 -- 172.21.15.106:0/3478492213 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80039e0 con 0x7f43f80679d0 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f81484d0 con 0x7f43f80679d0 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.640+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f81481a0 con 0x7f43f80679d0 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.641+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f8068a90 con 0x7f43f80679d0 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.642+0000 7f43f4ff9640 1 -- 172.21.15.106:0/3478492213 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43e801a070 con 0x7f43f80679d0 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.642+0000 7f43f4ff9640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f43e406c920 0x7f43e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.642+0000 7f43f4ff9640 1 -- 172.21.15.106:0/3478492213 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f43e808ad30 con 0x7f43f80679d0 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.642+0000 7f43f77fe640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f43e406c920 0x7f43e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.643+0000 7f43f77fe640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f43e406c920 0x7f43e406ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43f813f500 tx=0x7f43ec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:08.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.646+0000 7f43f4ff9640 1 -- 172.21.15.106:0/3478492213 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43e8058b80 con 0x7f43f80679d0 2024-04-16T12:58:08.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.822+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43f80b0690 con 0x7f43e406c920 2024-04-16T12:58:08.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.827+0000 7f43f4ff9640 1 -- 172.21.15.106:0/3478492213 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f43f80b0690 con 0x7f43e406c920 2024-04-16T12:58:08.831 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:08.833 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:08.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f43e406c920 msgr2=0x7f43e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f43e406c920 0x7f43e406ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43f813f500 tx=0x7f43ec009040 comp rx=0 tx=0).stop 2024-04-16T12:58:08.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f80679d0 msgr2=0x7f43f81cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f80679d0 0x7f43f81cf050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43e800c4e0 tx=0x7f43e800c9a0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 shutdown_connections 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f43e406c920 0x7f43e406ede0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f80b0ac0 0x7f43f81dd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f809fb60 0x7f43f81d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 --2- 172.21.15.106:0/3478492213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f80679d0 0x7f43f81cf050 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 >> 172.21.15.106:0/3478492213 conn(0x7f43f80b9ca0 msgr2=0x7f43f8070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 shutdown_connections 2024-04-16T12:58:08.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.830+0000 7f43fe269640 1 -- 172.21.15.106:0/3478492213 wait complete. 2024-04-16T12:58:08.843 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-04-16T12:58:08.174896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.769574"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557061+0000","last_change":"2024-04-16T12:57:58.417066+0000","last_active":"2024-04-16T12:57:59.557061+0000","last_peered":"2024-04-16T12:57:59.557061+0000","last_clean":"2024-04-16T12:57:59.557061+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:57:59.557061+0000","last_undegraded":"2024-04-16T12:57:59.557061+0000","last_fullsized":"2024-04-16T12:57:59.557061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:40.783094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557293+0000","last_change":"2024-04-16T12:57:58.414223+0000","last_active":"2024-04-16T12:57:59.557293+0000","last_peered":"2024-04-16T12:57:59.557293+0000","last_clean":"2024-04-16T12:57:59.557293+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:57:59.557293+0000","last_undegraded":"2024-04-16T12:57:59.557293+0000","last_fullsized":"2024-04-16T12:57:59.557293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:04.064696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408863+0000","last_change":"2024-04-16T12:57:58.429706+0000","last_active":"2024-04-16T12:57:59.408863+0000","last_peered":"2024-04-16T12:57:59.408863+0000","last_clean":"2024-04-16T12:57:59.408863+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:57:59.408863+0000","last_undegraded":"2024-04-16T12:57:59.408863+0000","last_fullsized":"2024-04-16T12:57:59.408863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410150+0000","last_change":"2024-04-16T12:57:58.432119+0000","last_active":"2024-04-16T12:57:59.410150+0000","last_peered":"2024-04-16T12:57:59.410150+0000","last_clean":"2024-04-16T12:57:59.410150+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:57:59.410150+0000","last_undegraded":"2024-04-16T12:57:59.410150+0000","last_fullsized":"2024-04-16T12:57:59.410150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557573+0000","last_change":"2024-04-16T12:57:58.415012+0000","last_active":"2024-04-16T12:57:59.557573+0000","last_peered":"2024-04-16T12:57:59.557573+0000","last_clean":"2024-04-16T12:57:59.557573+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:57:59.557573+0000","last_undegraded":"2024-04-16T12:57:59.557573+0000","last_fullsized":"2024-04-16T12:57:59.557573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:02.447913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556831+0000","last_change":"2024-04-16T12:57:58.423617+0000","last_active":"2024-04-16T12:57:59.556831+0000","last_peered":"2024-04-16T12:57:59.556831+0000","last_clean":"2024-04-16T12:57:59.556831+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:57:59.556831+0000","last_undegraded":"2024-04-16T12:57:59.556831+0000","last_fullsized":"2024-04-16T12:57:59.556831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409523+0000","last_change":"2024-04-16T12:57:58.421176+0000","last_active":"2024-04-16T12:57:59.409523+0000","last_peered":"2024-04-16T12:57:59.409523+0000","last_clean":"2024-04-16T12:57:59.409523+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:57:59.409523+0000","last_undegraded":"2024-04-16T12:57:59.409523+0000","last_fullsized":"2024-04-16T12:57:59.409523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408717+0000","last_change":"2024-04-16T12:57:58.420336+0000","last_active":"2024-04-16T12:57:59.408717+0000","last_peered":"2024-04-16T12:57:59.408717+0000","last_clean":"2024-04-16T12:57:59.408717+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:57:59.408717+0000","last_undegraded":"2024-04-16T12:57:59.408717+0000","last_fullsized":"2024-04-16T12:57:59.408717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557536+0000","last_change":"2024-04-16T12:57:58.427221+0000","last_active":"2024-04-16T12:57:59.557536+0000","last_peered":"2024-04-16T12:57:59.557536+0000","last_clean":"2024-04-16T12:57:59.557536+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:57:59.557536+0000","last_undegraded":"2024-04-16T12:57:59.557536+0000","last_fullsized":"2024-04-16T12:57:59.557536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410349+0000","last_change":"2024-04-16T12:57:58.414532+0000","last_active":"2024-04-16T12:57:59.410349+0000","last_peered":"2024-04-16T12:57:59.410349+0000","last_clean":"2024-04-16T12:57:59.410349+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:57:59.410349+0000","last_undegraded":"2024-04-16T12:57:59.410349+0000","last_fullsized":"2024-04-16T12:57:59.410349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:33.604830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409656+0000","last_change":"2024-04-16T12:57:58.419590+0000","last_active":"2024-04-16T12:57:59.409656+0000","last_peered":"2024-04-16T12:57:59.409656+0000","last_clean":"2024-04-16T12:57:59.409656+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:57:59.409656+0000","last_undegraded":"2024-04-16T12:57:59.409656+0000","last_fullsized":"2024-04-16T12:57:59.409656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408763+0000","last_change":"2024-04-16T12:57:58.420968+0000","last_active":"2024-04-16T12:57:59.408763+0000","last_peered":"2024-04-16T12:57:59.408763+0000","last_clean":"2024-04-16T12:57:59.408763+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:57:59.408763+0000","last_undegraded":"2024-04-16T12:57:59.408763+0000","last_fullsized":"2024-04-16T12:57:59.408763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557659+0000","last_change":"2024-04-16T12:57:58.424597+0000","last_active":"2024-04-16T12:57:59.557659+0000","last_peered":"2024-04-16T12:57:59.557659+0000","last_clean":"2024-04-16T12:57:59.557659+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:57:59.557659+0000","last_undegraded":"2024-04-16T12:57:59.557659+0000","last_fullsized":"2024-04-16T12:57:59.557659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:58.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556986+0000","last_change":"2024-04-16T12:57:58.411816+0000","last_active":"2024-04-16T12:57:59.556986+0000","last_peered":"2024-04-16T12:57:59.556986+0000","last_clean":"2024-04-16T12:57:59.556986+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:57:59.556986+0000","last_undegraded":"2024-04-16T12:57:59.556986+0000","last_fullsized":"2024-04-16T12:57:59.556986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408901+0000","last_change":"2024-04-16T12:57:58.419271+0000","last_active":"2024-04-16T12:57:59.408901+0000","last_peered":"2024-04-16T12:57:59.408901+0000","last_clean":"2024-04-16T12:57:59.408901+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:57:59.408901+0000","last_undegraded":"2024-04-16T12:57:59.408901+0000","last_fullsized":"2024-04-16T12:57:59.408901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409323+0000","last_change":"2024-04-16T12:57:58.421606+0000","last_active":"2024-04-16T12:57:59.409323+0000","last_peered":"2024-04-16T12:57:59.409323+0000","last_clean":"2024-04-16T12:57:59.409323+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:57:59.409323+0000","last_undegraded":"2024-04-16T12:57:59.409323+0000","last_fullsized":"2024-04-16T12:57:59.409323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409307+0000","last_change":"2024-04-16T12:57:58.421726+0000","last_active":"2024-04-16T12:57:59.409307+0000","last_peered":"2024-04-16T12:57:59.409307+0000","last_clean":"2024-04-16T12:57:59.409307+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:57:59.409307+0000","last_undegraded":"2024-04-16T12:57:59.409307+0000","last_fullsized":"2024-04-16T12:57:59.409307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557302+0000","last_change":"2024-04-16T12:57:58.417403+0000","last_active":"2024-04-16T12:57:59.557302+0000","last_peered":"2024-04-16T12:57:59.557302+0000","last_clean":"2024-04-16T12:57:59.557302+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:57:59.557302+0000","last_undegraded":"2024-04-16T12:57:59.557302+0000","last_fullsized":"2024-04-16T12:57:59.557302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:24.189968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556932+0000","last_change":"2024-04-16T12:57:58.423377+0000","last_active":"2024-04-16T12:57:59.556932+0000","last_peered":"2024-04-16T12:57:59.556932+0000","last_clean":"2024-04-16T12:57:59.556932+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:57:59.556932+0000","last_undegraded":"2024-04-16T12:57:59.556932+0000","last_fullsized":"2024-04-16T12:57:59.556932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557686+0000","last_change":"2024-04-16T12:57:58.422790+0000","last_active":"2024-04-16T12:57:59.557686+0000","last_peered":"2024-04-16T12:57:59.557686+0000","last_clean":"2024-04-16T12:57:59.557686+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:57:59.557686+0000","last_undegraded":"2024-04-16T12:57:59.557686+0000","last_fullsized":"2024-04-16T12:57:59.557686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:04.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557897+0000","last_change":"2024-04-16T12:57:58.432630+0000","last_active":"2024-04-16T12:57:59.557897+0000","last_peered":"2024-04-16T12:57:59.557897+0000","last_clean":"2024-04-16T12:57:59.557897+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:57:59.557897+0000","last_undegraded":"2024-04-16T12:57:59.557897+0000","last_fullsized":"2024-04-16T12:57:59.557897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557157+0000","last_change":"2024-04-16T12:57:58.428165+0000","last_active":"2024-04-16T12:57:59.557157+0000","last_peered":"2024-04-16T12:57:59.557157+0000","last_clean":"2024-04-16T12:57:59.557157+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:57:59.557157+0000","last_undegraded":"2024-04-16T12:57:59.557157+0000","last_fullsized":"2024-04-16T12:57:59.557157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556657+0000","last_change":"2024-04-16T12:57:58.419322+0000","last_active":"2024-04-16T12:57:59.556657+0000","last_peered":"2024-04-16T12:57:59.556657+0000","last_clean":"2024-04-16T12:57:59.556657+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:57:59.556657+0000","last_undegraded":"2024-04-16T12:57:59.556657+0000","last_fullsized":"2024-04-16T12:57:59.556657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408594+0000","last_change":"2024-04-16T12:57:58.425245+0000","last_active":"2024-04-16T12:57:59.408594+0000","last_peered":"2024-04-16T12:57:59.408594+0000","last_clean":"2024-04-16T12:57:59.408594+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:57:59.408594+0000","last_undegraded":"2024-04-16T12:57:59.408594+0000","last_fullsized":"2024-04-16T12:57:59.408594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410326+0000","last_change":"2024-04-16T12:57:58.422256+0000","last_active":"2024-04-16T12:57:59.410326+0000","last_peered":"2024-04-16T12:57:59.410326+0000","last_clean":"2024-04-16T12:57:59.410326+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:57:59.410326+0000","last_undegraded":"2024-04-16T12:57:59.410326+0000","last_fullsized":"2024-04-16T12:57:59.410326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557449+0000","last_change":"2024-04-16T12:57:58.421697+0000","last_active":"2024-04-16T12:57:59.557449+0000","last_peered":"2024-04-16T12:57:59.557449+0000","last_clean":"2024-04-16T12:57:59.557449+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:57:59.557449+0000","last_undegraded":"2024-04-16T12:57:59.557449+0000","last_fullsized":"2024-04-16T12:57:59.557449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:39.008329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410430+0000","last_change":"2024-04-16T12:57:58.429064+0000","last_active":"2024-04-16T12:57:59.410430+0000","last_peered":"2024-04-16T12:57:59.410430+0000","last_clean":"2024-04-16T12:57:59.410430+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:57:59.410430+0000","last_undegraded":"2024-04-16T12:57:59.410430+0000","last_fullsized":"2024-04-16T12:57:59.410430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408814+0000","last_change":"2024-04-16T12:57:58.420144+0000","last_active":"2024-04-16T12:57:59.408814+0000","last_peered":"2024-04-16T12:57:59.408814+0000","last_clean":"2024-04-16T12:57:59.408814+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:57:59.408814+0000","last_undegraded":"2024-04-16T12:57:59.408814+0000","last_fullsized":"2024-04-16T12:57:59.408814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557851+0000","last_change":"2024-04-16T12:57:58.428551+0000","last_active":"2024-04-16T12:57:59.557851+0000","last_peered":"2024-04-16T12:57:59.557851+0000","last_clean":"2024-04-16T12:57:59.557851+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:57:59.557851+0000","last_undegraded":"2024-04-16T12:57:59.557851+0000","last_fullsized":"2024-04-16T12:57:59.557851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408962+0000","last_change":"2024-04-16T12:57:58.419164+0000","last_active":"2024-04-16T12:57:59.408962+0000","last_peered":"2024-04-16T12:57:59.408962+0000","last_clean":"2024-04-16T12:57:59.408962+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:57:59.408962+0000","last_undegraded":"2024-04-16T12:57:59.408962+0000","last_fullsized":"2024-04-16T12:57:59.408962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557022+0000","last_change":"2024-04-16T12:57:58.417480+0000","last_active":"2024-04-16T12:57:59.557022+0000","last_peered":"2024-04-16T12:57:59.557022+0000","last_clean":"2024-04-16T12:57:59.557022+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:57:59.557022+0000","last_undegraded":"2024-04-16T12:57:59.557022+0000","last_fullsized":"2024-04-16T12:57:59.557022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:55:29.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408880+0000","last_change":"2024-04-16T12:57:58.429121+0000","last_active":"2024-04-16T12:57:59.408880+0000","last_peered":"2024-04-16T12:57:59.408880+0000","last_clean":"2024-04-16T12:57:59.408880+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:57:59.408880+0000","last_undegraded":"2024-04-16T12:57:59.408880+0000","last_fullsized":"2024-04-16T12:57:59.408880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.529728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557103+0000","last_change":"2024-04-16T12:57:58.425769+0000","last_active":"2024-04-16T12:57:59.557103+0000","last_peered":"2024-04-16T12:57:59.557103+0000","last_clean":"2024-04-16T12:57:59.557103+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:57:59.557103+0000","last_undegraded":"2024-04-16T12:57:59.557103+0000","last_fullsized":"2024-04-16T12:57:59.557103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557168+0000","last_change":"2024-04-16T12:57:57.419875+0000","last_active":"2024-04-16T12:57:59.557168+0000","last_peered":"2024-04-16T12:57:59.557168+0000","last_clean":"2024-04-16T12:57:59.557168+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:57:59.557168+0000","last_undegraded":"2024-04-16T12:57:59.557168+0000","last_fullsized":"2024-04-16T12:57:59.557168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556949+0000","last_change":"2024-04-16T12:57:58.429507+0000","last_active":"2024-04-16T12:57:59.556949+0000","last_peered":"2024-04-16T12:57:59.556949+0000","last_clean":"2024-04-16T12:57:59.556949+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:57:59.556949+0000","last_undegraded":"2024-04-16T12:57:59.556949+0000","last_fullsized":"2024-04-16T12:57:59.556949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:48.320225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557195+0000","last_change":"2024-04-16T12:57:57.409560+0000","last_active":"2024-04-16T12:57:59.557195+0000","last_peered":"2024-04-16T12:57:59.557195+0000","last_clean":"2024-04-16T12:57:59.557195+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:57:59.557195+0000","last_undegraded":"2024-04-16T12:57:59.557195+0000","last_fullsized":"2024-04-16T12:57:59.557195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557564+0000","last_change":"2024-04-16T12:57:58.430344+0000","last_active":"2024-04-16T12:57:59.557564+0000","last_peered":"2024-04-16T12:57:59.557564+0000","last_clean":"2024-04-16T12:57:59.557564+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:57:59.557564+0000","last_undegraded":"2024-04-16T12:57:59.557564+0000","last_fullsized":"2024-04-16T12:57:59.557564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557003+0000","last_change":"2024-04-16T12:57:57.421388+0000","last_active":"2024-04-16T12:57:59.557003+0000","last_peered":"2024-04-16T12:57:59.557003+0000","last_clean":"2024-04-16T12:57:59.557003+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:57:59.557003+0000","last_undegraded":"2024-04-16T12:57:59.557003+0000","last_fullsized":"2024-04-16T12:57:59.557003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:23.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410459+0000","last_change":"2024-04-16T12:57:58.427164+0000","last_active":"2024-04-16T12:57:59.410459+0000","last_peered":"2024-04-16T12:57:59.410459+0000","last_clean":"2024-04-16T12:57:59.410459+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:57:59.410459+0000","last_undegraded":"2024-04-16T12:57:59.410459+0000","last_fullsized":"2024-04-16T12:57:59.410459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557793+0000","last_change":"2024-04-16T12:57:57.419891+0000","last_active":"2024-04-16T12:57:59.557793+0000","last_peered":"2024-04-16T12:57:59.557793+0000","last_clean":"2024-04-16T12:57:59.557793+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:57:59.557793+0000","last_undegraded":"2024-04-16T12:57:59.557793+0000","last_fullsized":"2024-04-16T12:57:59.557793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:48.386771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409438+0000","last_change":"2024-04-16T12:57:58.428187+0000","last_active":"2024-04-16T12:57:59.409438+0000","last_peered":"2024-04-16T12:57:59.409438+0000","last_clean":"2024-04-16T12:57:59.409438+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:57:59.409438+0000","last_undegraded":"2024-04-16T12:57:59.409438+0000","last_fullsized":"2024-04-16T12:57:59.409438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557927+0000","last_change":"2024-04-16T12:57:57.419136+0000","last_active":"2024-04-16T12:57:59.557927+0000","last_peered":"2024-04-16T12:57:59.557927+0000","last_clean":"2024-04-16T12:57:59.557927+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:57:59.557927+0000","last_undegraded":"2024-04-16T12:57:59.557927+0000","last_fullsized":"2024-04-16T12:57:59.557927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408786+0000","last_change":"2024-04-16T12:57:58.428624+0000","last_active":"2024-04-16T12:57:59.408786+0000","last_peered":"2024-04-16T12:57:59.408786+0000","last_clean":"2024-04-16T12:57:59.408786+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:57:59.408786+0000","last_undegraded":"2024-04-16T12:57:59.408786+0000","last_fullsized":"2024-04-16T12:57:59.408786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557287+0000","last_change":"2024-04-16T12:57:57.418607+0000","last_active":"2024-04-16T12:57:59.557287+0000","last_peered":"2024-04-16T12:57:59.557287+0000","last_clean":"2024-04-16T12:57:59.557287+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:57:59.557287+0000","last_undegraded":"2024-04-16T12:57:59.557287+0000","last_fullsized":"2024-04-16T12:57:59.557287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:17.248246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556971+0000","last_change":"2024-04-16T12:57:58.426553+0000","last_active":"2024-04-16T12:57:59.556971+0000","last_peered":"2024-04-16T12:57:59.556971+0000","last_clean":"2024-04-16T12:57:59.556971+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:57:59.556971+0000","last_undegraded":"2024-04-16T12:57:59.556971+0000","last_fullsized":"2024-04-16T12:57:59.556971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556800+0000","last_change":"2024-04-16T12:57:57.418496+0000","last_active":"2024-04-16T12:57:59.556800+0000","last_peered":"2024-04-16T12:57:59.556800+0000","last_clean":"2024-04-16T12:57:59.556800+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:57:59.556800+0000","last_undegraded":"2024-04-16T12:57:59.556800+0000","last_fullsized":"2024-04-16T12:57:59.556800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409997+0000","last_change":"2024-04-16T12:57:58.421803+0000","last_active":"2024-04-16T12:57:59.409997+0000","last_peered":"2024-04-16T12:57:59.409997+0000","last_clean":"2024-04-16T12:57:59.409997+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:57:59.409997+0000","last_undegraded":"2024-04-16T12:57:59.409997+0000","last_fullsized":"2024-04-16T12:57:59.409997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557158+0000","last_change":"2024-04-16T12:57:57.417993+0000","last_active":"2024-04-16T12:57:59.557158+0000","last_peered":"2024-04-16T12:57:59.557158+0000","last_clean":"2024-04-16T12:57:59.557158+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:57:59.557158+0000","last_undegraded":"2024-04-16T12:57:59.557158+0000","last_fullsized":"2024-04-16T12:57:59.557158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:27:27.583239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409611+0000","last_change":"2024-04-16T12:57:58.421729+0000","last_active":"2024-04-16T12:57:59.409611+0000","last_peered":"2024-04-16T12:57:59.409611+0000","last_clean":"2024-04-16T12:57:59.409611+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:57:59.409611+0000","last_undegraded":"2024-04-16T12:57:59.409611+0000","last_fullsized":"2024-04-16T12:57:59.409611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556740+0000","last_change":"2024-04-16T12:57:57.419936+0000","last_active":"2024-04-16T12:57:59.556740+0000","last_peered":"2024-04-16T12:57:59.556740+0000","last_clean":"2024-04-16T12:57:59.556740+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:57:59.556740+0000","last_undegraded":"2024-04-16T12:57:59.556740+0000","last_fullsized":"2024-04-16T12:57:59.556740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:09.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556761+0000","last_change":"2024-04-16T12:57:58.423776+0000","last_active":"2024-04-16T12:57:59.556761+0000","last_peered":"2024-04-16T12:57:59.556761+0000","last_clean":"2024-04-16T12:57:59.556761+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:57:59.556761+0000","last_undegraded":"2024-04-16T12:57:59.556761+0000","last_fullsized":"2024-04-16T12:57:59.556761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557282+0000","last_change":"2024-04-16T12:57:57.418768+0000","last_active":"2024-04-16T12:57:59.557282+0000","last_peered":"2024-04-16T12:57:59.557282+0000","last_clean":"2024-04-16T12:57:59.557282+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:57:59.557282+0000","last_undegraded":"2024-04-16T12:57:59.557282+0000","last_fullsized":"2024-04-16T12:57:59.557282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557137+0000","last_change":"2024-04-16T12:57:58.421105+0000","last_active":"2024-04-16T12:57:59.557137+0000","last_peered":"2024-04-16T12:57:59.557137+0000","last_clean":"2024-04-16T12:57:59.557137+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:57:59.557137+0000","last_undegraded":"2024-04-16T12:57:59.557137+0000","last_fullsized":"2024-04-16T12:57:59.557137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408991+0000","last_change":"2024-04-16T12:57:57.416238+0000","last_active":"2024-04-16T12:57:59.408991+0000","last_peered":"2024-04-16T12:57:59.408991+0000","last_clean":"2024-04-16T12:57:59.408991+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:57:59.408991+0000","last_undegraded":"2024-04-16T12:57:59.408991+0000","last_fullsized":"2024-04-16T12:57:59.408991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408608+0000","last_change":"2024-04-16T12:57:58.428014+0000","last_active":"2024-04-16T12:57:59.408608+0000","last_peered":"2024-04-16T12:57:59.408608+0000","last_clean":"2024-04-16T12:57:59.408608+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:57:59.408608+0000","last_undegraded":"2024-04-16T12:57:59.408608+0000","last_fullsized":"2024-04-16T12:57:59.408608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557150+0000","last_change":"2024-04-16T12:57:57.421382+0000","last_active":"2024-04-16T12:57:59.557150+0000","last_peered":"2024-04-16T12:57:59.557150+0000","last_clean":"2024-04-16T12:57:59.557150+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:57:59.557150+0000","last_undegraded":"2024-04-16T12:57:59.557150+0000","last_fullsized":"2024-04-16T12:57:59.557150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:09.260220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410034+0000","last_change":"2024-04-16T12:57:58.417617+0000","last_active":"2024-04-16T12:57:59.410034+0000","last_peered":"2024-04-16T12:57:59.410034+0000","last_clean":"2024-04-16T12:57:59.410034+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:57:59.410034+0000","last_undegraded":"2024-04-16T12:57:59.410034+0000","last_fullsized":"2024-04-16T12:57:59.410034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.558015+0000","last_change":"2024-04-16T12:57:57.419094+0000","last_active":"2024-04-16T12:57:59.558015+0000","last_peered":"2024-04-16T12:57:59.558015+0000","last_clean":"2024-04-16T12:57:59.558015+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:57:59.558015+0000","last_undegraded":"2024-04-16T12:57:59.558015+0000","last_fullsized":"2024-04-16T12:57:59.558015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557010+0000","last_change":"2024-04-16T12:57:58.414688+0000","last_active":"2024-04-16T12:57:59.557010+0000","last_peered":"2024-04-16T12:57:59.557010+0000","last_clean":"2024-04-16T12:57:59.557010+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:57:59.557010+0000","last_undegraded":"2024-04-16T12:57:59.557010+0000","last_fullsized":"2024-04-16T12:57:59.557010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410019+0000","last_change":"2024-04-16T12:57:57.416542+0000","last_active":"2024-04-16T12:57:59.410019+0000","last_peered":"2024-04-16T12:57:59.410019+0000","last_clean":"2024-04-16T12:57:59.410019+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:57:59.410019+0000","last_undegraded":"2024-04-16T12:57:59.410019+0000","last_fullsized":"2024-04-16T12:57:59.410019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409146+0000","last_change":"2024-04-16T12:57:58.429363+0000","last_active":"2024-04-16T12:57:59.409146+0000","last_peered":"2024-04-16T12:57:59.409146+0000","last_clean":"2024-04-16T12:57:59.409146+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:57:59.409146+0000","last_undegraded":"2024-04-16T12:57:59.409146+0000","last_fullsized":"2024-04-16T12:57:59.409146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557034+0000","last_change":"2024-04-16T12:57:57.417272+0000","last_active":"2024-04-16T12:57:59.557034+0000","last_peered":"2024-04-16T12:57:59.557034+0000","last_clean":"2024-04-16T12:57:59.557034+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:57:59.557034+0000","last_undegraded":"2024-04-16T12:57:59.557034+0000","last_fullsized":"2024-04-16T12:57:59.557034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:19.085142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:58.428318+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556658+0000","last_change":"2024-04-16T12:57:57.418665+0000","last_active":"2024-04-16T12:57:59.556658+0000","last_peered":"2024-04-16T12:57:59.556658+0000","last_clean":"2024-04-16T12:57:59.556658+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:57:59.556658+0000","last_undegraded":"2024-04-16T12:57:59.556658+0000","last_fullsized":"2024-04-16T12:57:59.556658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:39.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557740+0000","last_change":"2024-04-16T12:57:58.424884+0000","last_active":"2024-04-16T12:57:59.557740+0000","last_peered":"2024-04-16T12:57:59.557740+0000","last_clean":"2024-04-16T12:57:59.557740+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:57:59.557740+0000","last_undegraded":"2024-04-16T12:57:59.557740+0000","last_fullsized":"2024-04-16T12:57:59.557740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410365+0000","last_change":"2024-04-16T12:57:57.417511+0000","last_active":"2024-04-16T12:57:59.410365+0000","last_peered":"2024-04-16T12:57:59.410365+0000","last_clean":"2024-04-16T12:57:59.410365+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:57:59.410365+0000","last_undegraded":"2024-04-16T12:57:59.410365+0000","last_fullsized":"2024-04-16T12:57:59.410365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409706+0000","last_change":"2024-04-16T12:57:58.431315+0000","last_active":"2024-04-16T12:57:59.409706+0000","last_peered":"2024-04-16T12:57:59.409706+0000","last_clean":"2024-04-16T12:57:59.409706+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:57:59.409706+0000","last_undegraded":"2024-04-16T12:57:59.409706+0000","last_fullsized":"2024-04-16T12:57:59.409706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557710+0000","last_change":"2024-04-16T12:57:57.419368+0000","last_active":"2024-04-16T12:57:59.557710+0000","last_peered":"2024-04-16T12:57:59.557710+0000","last_clean":"2024-04-16T12:57:59.557710+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:57:59.557710+0000","last_undegraded":"2024-04-16T12:57:59.557710+0000","last_fullsized":"2024-04-16T12:57:59.557710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410299+0000","last_change":"2024-04-16T12:57:58.431490+0000","last_active":"2024-04-16T12:57:59.410299+0000","last_peered":"2024-04-16T12:57:59.410299+0000","last_clean":"2024-04-16T12:57:59.410299+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:57:59.410299+0000","last_undegraded":"2024-04-16T12:57:59.410299+0000","last_fullsized":"2024-04-16T12:57:59.410299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557329+0000","last_change":"2024-04-16T12:57:57.418637+0000","last_active":"2024-04-16T12:57:59.557329+0000","last_peered":"2024-04-16T12:57:59.557329+0000","last_clean":"2024-04-16T12:57:59.557329+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:57:59.557329+0000","last_undegraded":"2024-04-16T12:57:59.557329+0000","last_fullsized":"2024-04-16T12:57:59.557329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:49.553356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557676+0000","last_change":"2024-04-16T12:57:58.420291+0000","last_active":"2024-04-16T12:57:59.557676+0000","last_peered":"2024-04-16T12:57:59.557676+0000","last_clean":"2024-04-16T12:57:59.557676+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:57:59.557676+0000","last_undegraded":"2024-04-16T12:57:59.557676+0000","last_fullsized":"2024-04-16T12:57:59.557676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557561+0000","last_change":"2024-04-16T12:57:57.420173+0000","last_active":"2024-04-16T12:57:59.557561+0000","last_peered":"2024-04-16T12:57:59.557561+0000","last_clean":"2024-04-16T12:57:59.557561+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:57:59.557561+0000","last_undegraded":"2024-04-16T12:57:59.557561+0000","last_fullsized":"2024-04-16T12:57:59.557561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:01.440156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556745+0000","last_change":"2024-04-16T12:57:58.428239+0000","last_active":"2024-04-16T12:57:59.556745+0000","last_peered":"2024-04-16T12:57:59.556745+0000","last_clean":"2024-04-16T12:57:59.556745+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:57:59.556745+0000","last_undegraded":"2024-04-16T12:57:59.556745+0000","last_fullsized":"2024-04-16T12:57:59.556745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:18.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557492+0000","last_change":"2024-04-16T12:57:57.416742+0000","last_active":"2024-04-16T12:57:59.557492+0000","last_peered":"2024-04-16T12:57:59.557492+0000","last_clean":"2024-04-16T12:57:59.557492+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:57:59.557492+0000","last_undegraded":"2024-04-16T12:57:59.557492+0000","last_fullsized":"2024-04-16T12:57:59.557492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:28.073205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557717+0000","last_change":"2024-04-16T12:57:58.415256+0000","last_active":"2024-04-16T12:57:59.557717+0000","last_peered":"2024-04-16T12:57:59.557717+0000","last_clean":"2024-04-16T12:57:59.557717+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:57:59.557717+0000","last_undegraded":"2024-04-16T12:57:59.557717+0000","last_fullsized":"2024-04-16T12:57:59.557717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:44.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:57.418163+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556520+0000","last_change":"2024-04-16T12:57:58.422113+0000","last_active":"2024-04-16T12:57:59.556520+0000","last_peered":"2024-04-16T12:57:59.556520+0000","last_clean":"2024-04-16T12:57:59.556520+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:57:59.556520+0000","last_undegraded":"2024-04-16T12:57:59.556520+0000","last_fullsized":"2024-04-16T12:57:59.556520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:50.561113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557093+0000","last_change":"2024-04-16T12:57:57.420836+0000","last_active":"2024-04-16T12:57:59.557093+0000","last_peered":"2024-04-16T12:57:59.557093+0000","last_clean":"2024-04-16T12:57:59.557093+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:57:59.557093+0000","last_undegraded":"2024-04-16T12:57:59.557093+0000","last_fullsized":"2024-04-16T12:57:59.557093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409271+0000","last_change":"2024-04-16T12:57:58.418246+0000","last_active":"2024-04-16T12:57:59.409271+0000","last_peered":"2024-04-16T12:57:59.409271+0000","last_clean":"2024-04-16T12:57:59.409271+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:57:59.409271+0000","last_undegraded":"2024-04-16T12:57:59.409271+0000","last_fullsized":"2024-04-16T12:57:59.409271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408689+0000","last_change":"2024-04-16T12:57:57.415493+0000","last_active":"2024-04-16T12:57:59.408689+0000","last_peered":"2024-04-16T12:57:59.408689+0000","last_clean":"2024-04-16T12:57:59.408689+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:57:59.408689+0000","last_undegraded":"2024-04-16T12:57:59.408689+0000","last_fullsized":"2024-04-16T12:57:59.408689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557558+0000","last_change":"2024-04-16T12:57:58.424345+0000","last_active":"2024-04-16T12:57:59.557558+0000","last_peered":"2024-04-16T12:57:59.557558+0000","last_clean":"2024-04-16T12:57:59.557558+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:57:59.557558+0000","last_undegraded":"2024-04-16T12:57:59.557558+0000","last_fullsized":"2024-04-16T12:57:59.557558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:44.705042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410427+0000","last_change":"2024-04-16T12:57:57.419610+0000","last_active":"2024-04-16T12:57:59.410427+0000","last_peered":"2024-04-16T12:57:59.410427+0000","last_clean":"2024-04-16T12:57:59.410427+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:57:59.410427+0000","last_undegraded":"2024-04-16T12:57:59.410427+0000","last_fullsized":"2024-04-16T12:57:59.410427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:00:29.563675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409731+0000","last_change":"2024-04-16T12:57:58.428160+0000","last_active":"2024-04-16T12:57:59.409731+0000","last_peered":"2024-04-16T12:57:59.409731+0000","last_clean":"2024-04-16T12:57:59.409731+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:57:59.409731+0000","last_undegraded":"2024-04-16T12:57:59.409731+0000","last_fullsized":"2024-04-16T12:57:59.409731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557366+0000","last_change":"2024-04-16T12:57:57.415967+0000","last_active":"2024-04-16T12:57:59.557366+0000","last_peered":"2024-04-16T12:57:59.557366+0000","last_clean":"2024-04-16T12:57:59.557366+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:57:59.557366+0000","last_undegraded":"2024-04-16T12:57:59.557366+0000","last_fullsized":"2024-04-16T12:57:59.557366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556899+0000","last_change":"2024-04-16T12:57:58.419642+0000","last_active":"2024-04-16T12:57:59.556899+0000","last_peered":"2024-04-16T12:57:59.556899+0000","last_clean":"2024-04-16T12:57:59.556899+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:57:59.556899+0000","last_undegraded":"2024-04-16T12:57:59.556899+0000","last_fullsized":"2024-04-16T12:57:59.556899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410370+0000","last_change":"2024-04-16T12:57:57.416214+0000","last_active":"2024-04-16T12:57:59.410370+0000","last_peered":"2024-04-16T12:57:59.410370+0000","last_clean":"2024-04-16T12:57:59.410370+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:57:59.410370+0000","last_undegraded":"2024-04-16T12:57:59.410370+0000","last_fullsized":"2024-04-16T12:57:59.410370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557237+0000","last_change":"2024-04-16T12:57:58.420763+0000","last_active":"2024-04-16T12:57:59.557237+0000","last_peered":"2024-04-16T12:57:59.557237+0000","last_clean":"2024-04-16T12:57:59.557237+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:57:59.557237+0000","last_undegraded":"2024-04-16T12:57:59.557237+0000","last_fullsized":"2024-04-16T12:57:59.557237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557670+0000","last_change":"2024-04-16T12:57:57.413675+0000","last_active":"2024-04-16T12:57:59.557670+0000","last_peered":"2024-04-16T12:57:59.557670+0000","last_clean":"2024-04-16T12:57:59.557670+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:57:59.557670+0000","last_undegraded":"2024-04-16T12:57:59.557670+0000","last_fullsized":"2024-04-16T12:57:59.557670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:40.482372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557738+0000","last_change":"2024-04-16T12:57:58.417795+0000","last_active":"2024-04-16T12:57:59.557738+0000","last_peered":"2024-04-16T12:57:59.557738+0000","last_clean":"2024-04-16T12:57:59.557738+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:57:59.557738+0000","last_undegraded":"2024-04-16T12:57:59.557738+0000","last_fullsized":"2024-04-16T12:57:59.557738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.410124+0000","last_change":"2024-04-16T12:57:57.418446+0000","last_active":"2024-04-16T12:57:59.410124+0000","last_peered":"2024-04-16T12:57:59.410124+0000","last_clean":"2024-04-16T12:57:59.410124+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:57:59.410124+0000","last_undegraded":"2024-04-16T12:57:59.410124+0000","last_fullsized":"2024-04-16T12:57:59.410124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:00.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556666+0000","last_change":"2024-04-16T12:57:58.415348+0000","last_active":"2024-04-16T12:57:59.556666+0000","last_peered":"2024-04-16T12:57:59.556666+0000","last_clean":"2024-04-16T12:57:59.556666+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:57:59.556666+0000","last_undegraded":"2024-04-16T12:57:59.556666+0000","last_fullsized":"2024-04-16T12:57:59.556666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557259+0000","last_change":"2024-04-16T12:57:57.424470+0000","last_active":"2024-04-16T12:57:59.557259+0000","last_peered":"2024-04-16T12:57:59.557259+0000","last_clean":"2024-04-16T12:57:59.557259+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:57:59.557259+0000","last_undegraded":"2024-04-16T12:57:59.557259+0000","last_fullsized":"2024-04-16T12:57:59.557259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:43.697285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556938+0000","last_change":"2024-04-16T12:57:58.428240+0000","last_active":"2024-04-16T12:57:59.556938+0000","last_peered":"2024-04-16T12:57:59.556938+0000","last_clean":"2024-04-16T12:57:59.556938+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:57:59.556938+0000","last_undegraded":"2024-04-16T12:57:59.556938+0000","last_fullsized":"2024-04-16T12:57:59.556938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556773+0000","last_change":"2024-04-16T12:57:57.416527+0000","last_active":"2024-04-16T12:57:59.556773+0000","last_peered":"2024-04-16T12:57:59.556773+0000","last_clean":"2024-04-16T12:57:59.556773+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:57:59.556773+0000","last_undegraded":"2024-04-16T12:57:59.556773+0000","last_fullsized":"2024-04-16T12:57:59.556773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408749+0000","last_change":"2024-04-16T12:57:58.422936+0000","last_active":"2024-04-16T12:57:59.408749+0000","last_peered":"2024-04-16T12:57:59.408749+0000","last_clean":"2024-04-16T12:57:59.408749+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:57:59.408749+0000","last_undegraded":"2024-04-16T12:57:59.408749+0000","last_fullsized":"2024-04-16T12:57:59.408749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556749+0000","last_change":"2024-04-16T12:57:57.418379+0000","last_active":"2024-04-16T12:57:59.556749+0000","last_peered":"2024-04-16T12:57:59.556749+0000","last_clean":"2024-04-16T12:57:59.556749+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:57:59.556749+0000","last_undegraded":"2024-04-16T12:57:59.556749+0000","last_fullsized":"2024-04-16T12:57:59.556749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409385+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:59.409385+0000","last_peered":"2024-04-16T12:57:59.409385+0000","last_clean":"2024-04-16T12:57:59.409385+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:59.409385+0000","last_undegraded":"2024-04-16T12:57:59.409385+0000","last_fullsized":"2024-04-16T12:57:59.409385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:08.846 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:58:08.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.985+0000 7fe59fac1640 1 Processor -- start 2024-04-16T12:58:08.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.985+0000 7fe59fac1640 1 -- start start 2024-04-16T12:58:08.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59fac1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 0x7fe598151570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59fac1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59806f700 con 0x7fe5980b71b0 2024-04-16T12:58:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59fac1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5980b7590 con 0x7fe5980b82b0 2024-04-16T12:58:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59fac1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe5980ba200 con 0x7fe5981457a0 2024-04-16T12:58:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59d85d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe5980b71b0 0x7fe598149230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43004/0 (socket says 172.21.15.106:43004) 2024-04-16T12:58:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59d85d640 1 -- 172.21.15.106:0/3427860757 learned_addr learned my addr 172.21.15.106:0/3427860757 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503970646 0 0) 0x7fe59806f700 con 0x7fe5980b71b0 2024-04-16T12:58:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59e05e640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 0x7fe598151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe584003520 con 0x7fe5980b71b0 2024-04-16T12:58:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 360642070 0 0) 0x7fe584003520 con 0x7fe5980b71b0 2024-04-16T12:58:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 msgr2=0x7fe598151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 0x7fe598151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 >> v1:172.21.15.171:6789/0 conn(0x7fe5980b82b0 legacy=0x7fe598145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980b9570 con 0x7fe5980b71b0 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fe594001670 con 0x7fe5980b71b0 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.986+0000 7fe59e05e640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 0x7fe598151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 >> v1:172.21.15.106:6789/0 conn(0x7fe5980b71b0 legacy=0x7fe598149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59c85b640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5840039e0 0x7fe584003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59c85b640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 0x7fe584004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59c85b640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980ba200 con 0x7fe584004d40 2024-04-16T12:58:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe58400bad0 con 0x7fe5840039e0 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe58400bcd0 con 0x7fe5981457a0 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59e05e640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59d85d640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5840039e0 0x7fe584003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59d05c640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 0x7fe584004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59e05e640 1 -- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 msgr2=0x7fe584004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59e05e640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5981457a0 0x7fe584004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59e05e640 1 -- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5840039e0 msgr2=0x7fe584003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59e05e640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5840039e0 0x7fe584003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.987+0000 7fe59e05e640 1 -- 172.21.15.106:0/3427860757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe584003520 con 0x7fe584004d40 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59e05e640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5900073b0 tx=0x7fe584005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fc6c1bc64d628d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590039070 con 0x7fe584004d40 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59002cd30 con 0x7fe584004d40 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59c85b640 1 -- 172.21.15.106:0/3427860757 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590009c80 con 0x7fe584004d40 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59fac1640 1 -- 172.21.15.106:0/3427860757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 msgr2=0x7fe5840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59fac1640 1 --2- 172.21.15.106:0/3427860757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5900073b0 tx=0x7fe584005830 comp rx=0 tx=0).stop 2024-04-16T12:58:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59e05e640 1 -- 172.21.15.106:0/3427860757 reap_dead start 2024-04-16T12:58:08.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59fac1640 1 -- 172.21.15.106:0/3427860757 shutdown_connections 2024-04-16T12:58:08.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.988+0000 7fe59fac1640 1 -- 172.21.15.106:0/3427860757 >> 172.21.15.106:0/3427860757 conn(0x7fe5980ba4b0 msgr2=0x7fe5980ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:08.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.989+0000 7fe59fac1640 1 -- 172.21.15.106:0/3427860757 shutdown_connections 2024-04-16T12:58:08.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.989+0000 7fe59fac1640 1 -- 172.21.15.106:0/3427860757 wait complete. 2024-04-16T12:58:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 Processor -- start 2024-04-16T12:58:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 -- start start 2024-04-16T12:58:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5980b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5980b2550 0x7fe598143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe598144170 0x7fe5981445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980b9ce0 con 0x7fe584004d40 2024-04-16T12:58:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980b9a00 con 0x7fe5980b2550 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59fac1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe5980b9290 con 0x7fe598144170 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5980b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5980b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38896/0 (socket says 172.21.15.106:38896) 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 -- 172.21.15.106:0/952319342 learned_addr learned my addr 172.21.15.106:0/952319342 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d05c640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5980b2550 0x7fe598143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59e05e640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe598144170 0x7fe5981445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 -- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe598144170 msgr2=0x7fe5981445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe598144170 0x7fe5981445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:09.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 -- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5980b2550 msgr2=0x7fe598143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5980b2550 0x7fe598143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d85d640 1 -- 172.21.15.106:0/952319342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980726c0 con 0x7fe584004d40 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.990+0000 7fe59d05c640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5980b2550 0x7fe598143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.991+0000 7fe59d85d640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5980b3510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe594001b80 tx=0x7fe594007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.991+0000 7fe58e7fc640 1 -- 172.21.15.106:0/952319342 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59400f960 con 0x7fe584004d40 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.991+0000 7fe58e7fc640 1 -- 172.21.15.106:0/952319342 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe594018070 con 0x7fe584004d40 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.991+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5980b2aa0 con 0x7fe584004d40 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.991+0000 7fe58e7fc640 1 -- 172.21.15.106:0/952319342 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59400fd60 con 0x7fe584004d40 2024-04-16T12:58:09.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.991+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe598073830 con 0x7fe584004d40 2024-04-16T12:58:09.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.992+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe598068a90 con 0x7fe584004d40 2024-04-16T12:58:09.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.992+0000 7fe58e7fc640 1 -- 172.21.15.106:0/952319342 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe59401d460 con 0x7fe584004d40 2024-04-16T12:58:09.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.993+0000 7fe58e7fc640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe57c06c8f0 0x7fe57c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:09.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.993+0000 7fe58e7fc640 1 -- 172.21.15.106:0/952319342 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fe59408bc70 con 0x7fe584004d40 2024-04-16T12:58:09.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.993+0000 7fe59d05c640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe57c06c8f0 0x7fe57c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:09.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.993+0000 7fe59d05c640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe57c06c8f0 0x7fe57c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5980b0810 tx=0x7fe588009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:09.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:08.997+0000 7fe58e7fc640 1 -- 172.21.15.106:0/952319342 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe59405a130 con 0x7fe584004d40 2024-04-16T12:58:09.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~6s 2024-04-16T12:58:09.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.172+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe598149580 con 0x7fe584004d40 2024-04-16T12:58:09.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.173+0000 7fe58e7fc640 1 -- 172.21.15.106:0/952319342 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16669 (secure 0 0 0) 0x7fe594059a30 con 0x7fe584004d40 2024-04-16T12:58:09.175 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:09.175 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"2138f2ff-23aa-427d-a47c-cfcd7bf8d143","created":"2024-04-16T12:56:53.992091+0000","modified":"2024-04-16T12:57:59.404467+0000","last_up_change":"2024-04-16T12:57:05.243195+0000","last_in_change":"2024-04-16T12:56:56.203398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:57:06.180300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:57:56.243953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T12:57:56.712905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"350b0aaf-4d05-4145-9603-a86306f60a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6801","nonce":912307023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6803","nonce":912307023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6807","nonce":912307023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":912307023},{"type":"v1","addr":"172.21.15.106:6805","nonce":912307023}]},"public_addr":"172.21.15.106:6801/912307023","cluster_addr":"172.21.15.106:6803/912307023","heartbeat_back_addr":"172.21.15.106:6807/912307023","heartbeat_front_addr":"172.21.15.106:6805/912307023","state":["exists","up"]},{"osd":1,"uuid":"734e17f6-54f4-4693-87ef-12b52e98f242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6809","nonce":809484208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6811","nonce":809484208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6815","nonce":809484208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":809484208},{"type":"v1","addr":"172.21.15.106:6813","nonce":809484208}]},"public_addr":"172.21.15.106:6809/809484208","cluster_addr":"172.21.15.106:6811/809484208","heartbeat_back_addr":"172.21.15.106:6815/809484208","heartbeat_front_addr":"172.21.15.106:6813/809484208","state":["exists","up"]},{"osd":2,"uuid":"1033de9d-c8cf-4a1a-a586-0bde8aa0b091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6825","nonce":2939840684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6827","nonce":2939840684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6831","nonce":2939840684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2939840684},{"type":"v1","addr":"172.21.15.106:6829","nonce":2939840684}]},"public_addr":"172.21.15.106:6825/2939840684","cluster_addr":"172.21.15.106:6827/2939840684","heartbeat_back_addr":"172.21.15.106:6831/2939840684","heartbeat_front_addr":"172.21.15.106:6829/2939840684","state":["exists","up"]},{"osd":3,"uuid":"2b630c2e-866a-4281-96f5-7f4ffc204c0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6817","nonce":2118469111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6819","nonce":2118469111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6823","nonce":2118469111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2118469111},{"type":"v1","addr":"172.21.15.106:6821","nonce":2118469111}]},"public_addr":"172.21.15.106:6817/2118469111","cluster_addr":"172.21.15.106:6819/2118469111","heartbeat_back_addr":"172.21.15.106:6823/2118469111","heartbeat_front_addr":"172.21.15.106:6821/2118469111","state":["exists","up"]},{"osd":4,"uuid":"3dda85a1-e4c0-472e-a2d6-fa73e663fb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6807","nonce":37616255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6811","nonce":37616255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6815","nonce":37616255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37616255},{"type":"v1","addr":"172.21.15.171:6813","nonce":37616255}]},"public_addr":"172.21.15.171:6807/37616255","cluster_addr":"172.21.15.171:6811/37616255","heartbeat_back_addr":"172.21.15.171:6815/37616255","heartbeat_front_addr":"172.21.15.171:6813/37616255","state":["exists","up"]},{"osd":5,"uuid":"84208a16-4fc5-4ad0-b917-9d52fbd79cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6801","nonce":1858725458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6803","nonce":1858725458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6810","nonce":1858725458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1858725458},{"type":"v1","addr":"172.21.15.171:6806","nonce":1858725458}]},"public_addr":"172.21.15.171:6801/1858725458","cluster_addr":"172.21.15.171:6803/1858725458","heartbeat_back_addr":"172.21.15.171:6810/1858725458","heartbeat_front_addr":"172.21.15.171:6806/1858725458","state":["exists","up"]},{"osd":6,"uuid":"2913d7c6-baa0-47c1-b909-369d2b637a4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6819","nonce":2241406826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6823","nonce":2241406826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6831","nonce":2241406826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2241406826},{"type":"v1","addr":"172.21.15.171:6828","nonce":2241406826}]},"public_addr":"172.21.15.171:6819/2241406826","cluster_addr":"172.21.15.171:6823/2241406826","heartbeat_back_addr":"172.21.15.171:6831/2241406826","heartbeat_front_addr":"172.21.15.171:6828/2241406826","state":["exists","up"]},{"osd":7,"uuid":"c243b03a-53b4-410b-9c30-50aa6401582e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6818","nonce":676267245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6822","nonce":676267245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6827","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6829","nonce":676267245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":676267245},{"type":"v1","addr":"172.21.15.171:6825","nonce":676267245}]},"public_addr":"172.21.15.171:6818/676267245","cluster_addr":"172.21.15.171:6822/676267245","heartbeat_back_addr":"172.21.15.171:6829/676267245","heartbeat_front_addr":"172.21.15.171:6825/676267245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.392521+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.306021+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.435349+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.361086+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.438050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.320331+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.415575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:57:01.404541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:58:09.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe57c06c8f0 msgr2=0x7fe57c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:09.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe57c06c8f0 0x7fe57c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5980b0810 tx=0x7fe588009040 comp rx=0 tx=0).stop 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 msgr2=0x7fe5980b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5980b3510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe594001b80 tx=0x7fe594007720 comp rx=0 tx=0).stop 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 shutdown_connections 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe57c06c8f0 0x7fe57c06edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe598144170 0x7fe5981445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5980b2550 0x7fe598143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 --2- 172.21.15.106:0/952319342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe584004d40 0x7fe5980b3510 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:09.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.175+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 >> 172.21.15.106:0/952319342 conn(0x7fe5980ba4b0 msgr2=0x7fe598144e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:09.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.176+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 shutdown_connections 2024-04-16T12:58:09.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:09.176+0000 7fe59fac1640 1 -- 172.21.15.106:0/952319342 wait complete. 2024-04-16T12:58:10.189 INFO:tasks.ceph:Scrubbing osd.0 2024-04-16T12:58:10.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:10.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.296+0000 7f6858893640 1 Processor -- start 2024-04-16T12:58:10.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.296+0000 7f6858893640 1 -- start start 2024-04-16T12:58:10.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6858893640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540b50b0 0x7f6854073620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6858893640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f68540ae350 0x7f685414f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6858893640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68540b0160 con 0x7f6854073b60 2024-04-16T12:58:10.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6858893640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f6854144e60 con 0x7f68540ae350 2024-04-16T12:58:10.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6858893640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68540b5490 con 0x7f68540b50b0 2024-04-16T12:58:10.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6852d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f68540ae350 0x7f685414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f685259c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540b50b0 0x7f6854073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f684bfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f6854073b60 0x7f68541452f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:52216/0 (socket says 172.21.15.106:52216) 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f684bfff640 1 -- 172.21.15.106:0/577729477 learned_addr learned my addr 172.21.15.106:0/577729477 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6852d9d640 1 -- 172.21.15.106:0/577729477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540b50b0 msgr2=0x7f6854073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6852d9d640 1 --2- 172.21.15.106:0/577729477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540b50b0 0x7f6854073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6852d9d640 1 -- 172.21.15.106:0/577729477 >> v1:172.21.15.171:6789/0 conn(0x7f6854073b60 legacy=0x7f68541452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.297+0000 7f6852d9d640 1 -- 172.21.15.106:0/577729477 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68540ae870 con 0x7f68540ae350 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.298+0000 7f6852d9d640 1 --2- 172.21.15.106:0/577729477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68540ae350 0x7f685414f480 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f684c009d90 tx=0x7f684c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9961cb786165e335 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.298+0000 7f6851d9b640 1 -- 172.21.15.106:0/577729477 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c039070 con 0x7f68540ae350 2024-04-16T12:58:10.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.298+0000 7f6851d9b640 1 -- 172.21.15.106:0/577729477 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684c02cbc0 con 0x7f68540ae350 2024-04-16T12:58:10.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.298+0000 7f6851d9b640 1 -- 172.21.15.106:0/577729477 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c034440 con 0x7f68540ae350 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 -- 172.21.15.106:0/577729477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68540ae350 msgr2=0x7f685414f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 --2- 172.21.15.106:0/577729477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68540ae350 0x7f685414f480 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f684c009d90 tx=0x7f684c02be10 comp rx=0 tx=0).stop 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 -- 172.21.15.106:0/577729477 shutdown_connections 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 --2- 172.21.15.106:0/577729477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68540ae350 0x7f685414f480 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 --2- 172.21.15.106:0/577729477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540b50b0 0x7f6854073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 -- 172.21.15.106:0/577729477 >> 172.21.15.106:0/577729477 conn(0x7f68540b5e30 msgr2=0x7f68540b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 -- 172.21.15.106:0/577729477 shutdown_connections 2024-04-16T12:58:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.299+0000 7f6858893640 1 -- 172.21.15.106:0/577729477 wait complete. 2024-04-16T12:58:10.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.301+0000 7f6858893640 1 Processor -- start 2024-04-16T12:58:10.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.301+0000 7f6858893640 1 -- start start 2024-04-16T12:58:10.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f6858893640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6854073b60 0x7f685413b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f6858893640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540ae350 0x7f685413b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f6858893640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68540b50b0 0x7f68541ddb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f6858893640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6854145b80 con 0x7f6854073b60 2024-04-16T12:58:10.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f6858893640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6854145a00 con 0x7f68540b50b0 2024-04-16T12:58:10.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f6858893640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68540af140 con 0x7f68540ae350 2024-04-16T12:58:10.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6854073b60 0x7f685413b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6854073b60 0x7f685413b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38902/0 (socket says 172.21.15.106:38902) 2024-04-16T12:58:10.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 -- 172.21.15.106:0/1835127256 learned_addr learned my addr 172.21.15.106:0/1835127256 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:10.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f684bfff640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540ae350 0x7f685413b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f6852d9d640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68540b50b0 0x7f68541ddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 -- 172.21.15.106:0/1835127256 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540ae350 msgr2=0x7f685413b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68540ae350 0x7f685413b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 -- 172.21.15.106:0/1835127256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68540b50b0 msgr2=0x7f68541ddb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68540b50b0 0x7f68541ddb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 -- 172.21.15.106:0/1835127256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6854071830 con 0x7f6854073b60 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f685259c640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6854073b60 0x7f685413b400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6844010a80 tx=0x7f6844010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.302+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684401e070 con 0x7f6854073b60 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.303+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6844011450 con 0x7f6854073b60 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.303+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6854070390 con 0x7f6854073b60 2024-04-16T12:58:10.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.303+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844011820 con 0x7f6854073b60 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.303+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6854070f30 con 0x7f6854073b60 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.304+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6854071410 con 0x7f6854073b60 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.304+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6844021070 con 0x7f6854073b60 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f684affd640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f683406c8f0 0x7f683406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f684bfff640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f683406c8f0 0x7f683406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f684408dc50 con 0x7f6854073b60 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f684affd640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7f6834074af0 0x7f6834076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 --> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68340775c0 con 0x7f6834074af0 2024-04-16T12:58:10.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6844090350 con 0x7f6854073b60 2024-04-16T12:58:10.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f6852d9d640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7f6834074af0 0x7f6834076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f684bfff640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f683406c8f0 0x7f683406edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f685413c300 tx=0x7f683c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.305+0000 7f6852d9d640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7f6834074af0 0x7f6834076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.306+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== osd.0 v2:172.21.15.106:6800/912307023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68340775c0 con 0x7f6834074af0 2024-04-16T12:58:10.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.319+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 --> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6854068a90 con 0x7f6834074af0 2024-04-16T12:58:10.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.319+0000 7f684affd640 1 -- 172.21.15.106:0/1835127256 <== osd.0 v2:172.21.15.106:6800/912307023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6854068a90 con 0x7f6834074af0 2024-04-16T12:58:10.322 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:10.322 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:10.322 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:10.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.319+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7f6834074af0 msgr2=0x7f6834076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.319+0000 7f6858893640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6800/912307023,v1:172.21.15.106:6801/912307023] conn(0x7f6834074af0 0x7f6834076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f683406c8f0 msgr2=0x7f683406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f683406c8f0 0x7f683406edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f685413c300 tx=0x7f683c009040 comp rx=0 tx=0).stop 2024-04-16T12:58:10.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6854073b60 msgr2=0x7f685413b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 --2- 172.21.15.106:0/1835127256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6854073b60 0x7f685413b400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6844010a80 tx=0x7f6844010f40 comp rx=0 tx=0).stop 2024-04-16T12:58:10.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6852d9d640 1 -- 172.21.15.106:0/1835127256 reap_dead start 2024-04-16T12:58:10.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 shutdown_connections 2024-04-16T12:58:10.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 >> 172.21.15.106:0/1835127256 conn(0x7f68540b5e30 msgr2=0x7f685409aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 shutdown_connections 2024-04-16T12:58:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.320+0000 7f6858893640 1 -- 172.21.15.106:0/1835127256 wait complete. 2024-04-16T12:58:10.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-16T12:58:10.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.444+0000 7f58bb0b3640 1 Processor -- start 2024-04-16T12:58:10.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58bb0b3640 1 -- start start 2024-04-16T12:58:10.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58bb0b3640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f58b40b2970 0x7f58b413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58bb0b3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f58b413fef0 0x7f58b4150410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58bb0b3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b40b3a80 con 0x7f58b40bbe20 2024-04-16T12:58:10.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58bb0b3640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f58b41497d0 con 0x7f58b40b2970 2024-04-16T12:58:10.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58bb0b3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f58b4140300 con 0x7f58b413fef0 2024-04-16T12:58:10.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58b8e4f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f58b40bbe20 0x7f58b41490c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43016/0 (socket says 172.21.15.106:43016) 2024-04-16T12:58:10.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58b8e4f640 1 -- 172.21.15.106:0/1633238158 learned_addr learned my addr 172.21.15.106:0/1633238158 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:10.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.445+0000 7f58b3fff640 1 --2- 172.21.15.106:0/1633238158 >> v2:172.21.15.106:3300/0 conn(0x7f58b40b2970 0x7f58b413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b9650640 1 --2- 172.21.15.106:0/1633238158 >> v2:172.21.15.171:3300/0 conn(0x7f58b413fef0 0x7f58b4150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b37fe640 1 -- 172.21.15.106:0/1633238158 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967550851 0 0) 0x7f58b40b3a80 con 0x7f58b40bbe20 2024-04-16T12:58:10.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b37fe640 1 -- 172.21.15.106:0/1633238158 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a0003520 con 0x7f58b40bbe20 2024-04-16T12:58:10.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b3fff640 1 -- 172.21.15.106:0/1633238158 >> v2:172.21.15.171:3300/0 conn(0x7f58b413fef0 msgr2=0x7f58b4150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:10.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b3fff640 1 --2- 172.21.15.106:0/1633238158 >> v2:172.21.15.171:3300/0 conn(0x7f58b413fef0 0x7f58b4150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b3fff640 1 -- 172.21.15.106:0/1633238158 >> v1:172.21.15.106:6789/0 conn(0x7f58b40bbe20 legacy=0x7f58b41490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b3fff640 1 -- 172.21.15.106:0/1633238158 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b40bc200 con 0x7f58b40b2970 2024-04-16T12:58:10.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.446+0000 7f58b3fff640 1 --2- 172.21.15.106:0/1633238158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b413f9b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58b40b55c0 tx=0x7f58a402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b242441c700509c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58b37fe640 1 -- 172.21.15.106:0/1633238158 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4039070 con 0x7f58b40b2970 2024-04-16T12:58:10.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58b37fe640 1 -- 172.21.15.106:0/1633238158 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a402cbf0 con 0x7f58b40b2970 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58b37fe640 1 -- 172.21.15.106:0/1633238158 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4034440 con 0x7f58b40b2970 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 -- 172.21.15.106:0/1633238158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 msgr2=0x7f58b413f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/1633238158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b413f9b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58b40b55c0 tx=0x7f58a402be40 comp rx=0 tx=0).stop 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 -- 172.21.15.106:0/1633238158 shutdown_connections 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/1633238158 >> v2:172.21.15.171:3300/0 conn(0x7f58b413fef0 0x7f58b4150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/1633238158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b413f9b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 -- 172.21.15.106:0/1633238158 >> 172.21.15.106:0/1633238158 conn(0x7f58b4067e20 msgr2=0x7f58b40bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 -- 172.21.15.106:0/1633238158 shutdown_connections 2024-04-16T12:58:10.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.447+0000 7f58bb0b3640 1 -- 172.21.15.106:0/1633238158 wait complete. 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.448+0000 7f58bb0b3640 1 Processor -- start 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.448+0000 7f58bb0b3640 1 -- start start 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58bb0b3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b4143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58bb0b3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b40bbe20 0x7f58b41410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58bb0b3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58b413fef0 0x7f58b41ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58bb0b3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f58b40b4590 con 0x7f58b40b2970 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58bb0b3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58b40b42b0 con 0x7f58b40bbe20 2024-04-16T12:58:10.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58bb0b3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58b40b7960 con 0x7f58b413fef0 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b4143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b4143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38908/0 (socket says 172.21.15.106:38908) 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 -- 172.21.15.106:0/564214301 learned_addr learned my addr 172.21.15.106:0/564214301 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b9650640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58b413fef0 0x7f58b41ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 -- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58b413fef0 msgr2=0x7f58b41ddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58b413fef0 0x7f58b41ddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 -- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b40bbe20 msgr2=0x7f58b41410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b40bbe20 0x7f58b41410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 -- 172.21.15.106:0/564214301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b41cef90 con 0x7f58b40b2970 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b9650640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58b413fef0 0x7f58b41ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.449+0000 7f58b8e4f640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b4143270 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c430 tx=0x7f58ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.450+0000 7f58b17fa640 1 -- 172.21.15.106:0/564214301 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac017070 con 0x7f58b40b2970 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.450+0000 7f58b17fa640 1 -- 172.21.15.106:0/564214301 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac005ce0 con 0x7f58b40b2970 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.450+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b4141ed0 con 0x7f58b40b2970 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.450+0000 7f58b17fa640 1 -- 172.21.15.106:0/564214301 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0072f0 con 0x7f58b40b2970 2024-04-16T12:58:10.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.450+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b4141630 con 0x7f58b40b2970 2024-04-16T12:58:10.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.451+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b40691a0 con 0x7f58b40b2970 2024-04-16T12:58:10.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.451+0000 7f58b17fa640 1 -- 172.21.15.106:0/564214301 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58ac01a070 con 0x7f58b40b2970 2024-04-16T12:58:10.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.452+0000 7f58b17fa640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f589406c920 0x7f589406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.452+0000 7f58b17fa640 1 -- 172.21.15.106:0/564214301 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f58ac08af50 con 0x7f58b40b2970 2024-04-16T12:58:10.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.452+0000 7f58b3fff640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f589406c920 0x7f589406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.452+0000 7f58b3fff640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f589406c920 0x7f589406ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f58a4036000 tx=0x7f58a402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.456+0000 7f58b17fa640 1 -- 172.21.15.106:0/564214301 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58ac059410 con 0x7f58b40b2970 2024-04-16T12:58:10.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.632+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f58b40b3730 con 0x7f589406c920 2024-04-16T12:58:10.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.632+0000 7f58b17fa640 1 -- 172.21.15.106:0/564214301 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f58b40b3730 con 0x7f589406c920 2024-04-16T12:58:10.635 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 0 to deep-scrub 2024-04-16T12:58:10.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f589406c920 msgr2=0x7f589406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f589406c920 0x7f589406ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f58a4036000 tx=0x7f58a402e000 comp rx=0 tx=0).stop 2024-04-16T12:58:10.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 msgr2=0x7f58b4143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b4143270 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c430 tx=0x7f58ac00c8f0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 shutdown_connections 2024-04-16T12:58:10.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f589406c920 0x7f589406ede0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58b413fef0 0x7f58b41ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b40bbe20 0x7f58b41410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 --2- 172.21.15.106:0/564214301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40b2970 0x7f58b4143270 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 >> 172.21.15.106:0/564214301 conn(0x7f58b4067e20 msgr2=0x7f58b40b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:10.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 shutdown_connections 2024-04-16T12:58:10.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.634+0000 7f58bb0b3640 1 -- 172.21.15.106:0/564214301 wait complete. 2024-04-16T12:58:10.647 INFO:tasks.ceph:Scrubbing osd.1 2024-04-16T12:58:10.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.751+0000 7f53d39b5640 1 Processor -- start 2024-04-16T12:58:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.751+0000 7f53d39b5640 1 -- start start 2024-04-16T12:58:10.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d39b5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f53cc09b560 0x7f53cc1443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d39b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc144900 0x7f53cc09e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d39b5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53cc06ec00 con 0x7f53cc09eb70 2024-04-16T12:58:10.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d39b5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f53cc0ae580 con 0x7f53cc09b560 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d39b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc09b940 con 0x7f53cc144900 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d1f52640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f53cc09eb70 0x7f53cc147930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43020/0 (socket says 172.21.15.106:43020) 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d1f52640 1 -- 172.21.15.106:0/383953400 learned_addr learned my addr 172.21.15.106:0/383953400 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d1751640 1 --2- 172.21.15.106:0/383953400 >> v2:172.21.15.171:3300/0 conn(0x7f53cc09b560 0x7f53cc1443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.752+0000 7f53d0f50640 1 --2- 172.21.15.106:0/383953400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc144900 0x7f53cc09e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.753+0000 7f53c3fff640 1 -- 172.21.15.106:0/383953400 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383329083 0 0) 0x7f53cc06ec00 con 0x7f53cc09eb70 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.753+0000 7f53c3fff640 1 -- 172.21.15.106:0/383953400 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53b8004630 con 0x7f53cc09eb70 2024-04-16T12:58:10.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.753+0000 7f53d0f50640 1 -- 172.21.15.106:0/383953400 >> v2:172.21.15.171:3300/0 conn(0x7f53cc09b560 msgr2=0x7f53cc1443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:10.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.753+0000 7f53d0f50640 1 --2- 172.21.15.106:0/383953400 >> v2:172.21.15.171:3300/0 conn(0x7f53cc09b560 0x7f53cc1443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.753+0000 7f53d0f50640 1 -- 172.21.15.106:0/383953400 >> v1:172.21.15.106:6789/0 conn(0x7f53cc09eb70 legacy=0x7f53cc147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.753+0000 7f53d0f50640 1 -- 172.21.15.106:0/383953400 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc0af8f0 con 0x7f53cc144900 2024-04-16T12:58:10.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.753+0000 7f53d0f50640 1 --2- 172.21.15.106:0/383953400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc144900 0x7f53cc09e630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0097a0 tx=0x7f53bc02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc64774e9e1b5c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53c3fff640 1 -- 172.21.15.106:0/383953400 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc038070 con 0x7f53cc144900 2024-04-16T12:58:10.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53c3fff640 1 -- 172.21.15.106:0/383953400 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc031700 con 0x7f53cc144900 2024-04-16T12:58:10.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53c3fff640 1 -- 172.21.15.106:0/383953400 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc031ad0 con 0x7f53cc144900 2024-04-16T12:58:10.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 -- 172.21.15.106:0/383953400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc144900 msgr2=0x7f53cc09e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 --2- 172.21.15.106:0/383953400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc144900 0x7f53cc09e630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0097a0 tx=0x7f53bc02b7a0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 -- 172.21.15.106:0/383953400 shutdown_connections 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 --2- 172.21.15.106:0/383953400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc144900 0x7f53cc09e630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 --2- 172.21.15.106:0/383953400 >> v2:172.21.15.171:3300/0 conn(0x7f53cc09b560 0x7f53cc1443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 -- 172.21.15.106:0/383953400 >> 172.21.15.106:0/383953400 conn(0x7f53cc0b5e30 msgr2=0x7f53cc0b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 -- 172.21.15.106:0/383953400 shutdown_connections 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.754+0000 7f53d39b5640 1 -- 172.21.15.106:0/383953400 wait complete. 2024-04-16T12:58:10.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.755+0000 7f53d39b5640 1 Processor -- start 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.755+0000 7f53d39b5640 1 -- start start 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d39b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc09b560 0x7f53cc1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d39b5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc09eb70 0x7f53cc09cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d39b5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53cc144900 0x7f53cc09d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d39b5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc09efb0 con 0x7f53cc144900 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d39b5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc09bf00 con 0x7f53cc09eb70 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d39b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc0af550 con 0x7f53cc09b560 2024-04-16T12:58:10.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53cc144900 0x7f53cc09d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53cc144900 0x7f53cc09d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38924/0 (socket says 172.21.15.106:38924) 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 -- 172.21.15.106:0/3633562279 learned_addr learned my addr 172.21.15.106:0/3633562279 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1751640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc09b560 0x7f53cc1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d0f50640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc09eb70 0x7f53cc09cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 -- 172.21.15.106:0/3633562279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc09b560 msgr2=0x7f53cc1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53cc09b560 0x7f53cc1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 -- 172.21.15.106:0/3633562279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc09eb70 msgr2=0x7f53cc09cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc09eb70 0x7f53cc09cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d1f52640 1 -- 172.21.15.106:0/3633562279 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc072770 con 0x7f53cc144900 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.756+0000 7f53d0f50640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc09eb70 0x7f53cc09cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.757+0000 7f53d1f52640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53cc144900 0x7f53cc09d0c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53c400cb40 tx=0x7f53c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.757+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4017070 con 0x7f53cc144900 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.757+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c400aca0 con 0x7f53cc144900 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.757+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc1d98f0 con 0x7f53cc144900 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.757+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4012620 con 0x7f53cc144900 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.757+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc1d95d0 con 0x7f53cc144900 2024-04-16T12:58:10.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.758+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53cc068a90 con 0x7f53cc144900 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.758+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53c401a070 con 0x7f53cc144900 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53c1ffb640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f53b006c920 0x7f53b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f53c408b980 con 0x7f53cc144900 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53d1751640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f53b006c920 0x7f53b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53c1ffb640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f53b0074b20 0x7f53b0076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 --> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53b00775f0 con 0x7f53b0074b20 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f53c40902c0 con 0x7f53cc144900 2024-04-16T12:58:10.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53d0f50640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f53b0074b20 0x7f53b0076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53d1751640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f53b006c920 0x7f53b006ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009ad0 tx=0x7f53c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.759+0000 7f53d0f50640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f53b0074b20 0x7f53b0076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.760+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== osd.1 v2:172.21.15.106:6808/809484208 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53b00775f0 con 0x7f53b0074b20 2024-04-16T12:58:10.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.773+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 --> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f53cc072490 con 0x7f53b0074b20 2024-04-16T12:58:10.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53c1ffb640 1 -- 172.21.15.106:0/3633562279 <== osd.1 v2:172.21.15.106:6808/809484208 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f53cc072490 con 0x7f53b0074b20 2024-04-16T12:58:10.776 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:10.777 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:10.777 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:10.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f53b0074b20 msgr2=0x7f53b0076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6808/809484208,v1:172.21.15.106:6809/809484208] conn(0x7f53b0074b20 0x7f53b0076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f53b006c920 msgr2=0x7f53b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f53b006c920 0x7f53b006ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009ad0 tx=0x7f53c8008040 comp rx=0 tx=0).stop 2024-04-16T12:58:10.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53cc144900 msgr2=0x7f53cc09d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 --2- 172.21.15.106:0/3633562279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53cc144900 0x7f53cc09d0c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53c400cb40 tx=0x7f53c400a060 comp rx=0 tx=0).stop 2024-04-16T12:58:10.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d1f52640 1 -- 172.21.15.106:0/3633562279 reap_dead start 2024-04-16T12:58:10.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 shutdown_connections 2024-04-16T12:58:10.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 >> 172.21.15.106:0/3633562279 conn(0x7f53cc0b5e30 msgr2=0x7f53cc13f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:10.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 shutdown_connections 2024-04-16T12:58:10.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.774+0000 7f53d39b5640 1 -- 172.21.15.106:0/3633562279 wait complete. 2024-04-16T12:58:10.787 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-16T12:58:10.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.889+0000 7f4f4ab15640 1 Processor -- start 2024-04-16T12:58:10.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.889+0000 7f4f4ab15640 1 -- start start 2024-04-16T12:58:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f4ab15640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4f440679d0 0x7f4f440b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f4ab15640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f440b0ac0 0x7f4f440afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f4ab15640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f44067db0 con 0x7f4f4409fb60 2024-04-16T12:58:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f4ab15640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4f440b45f0 con 0x7f4f440679d0 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f4ab15640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f440b01c0 con 0x7f4f440b0ac0 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f488b1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4f440679d0 0x7f4f440b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f488b1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4f440679d0 0x7f4f440b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38938/0 (socket says 172.21.15.106:38938) 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f488b1640 1 -- 172.21.15.106:0/3415686628 learned_addr learned my addr 172.21.15.106:0/3415686628 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f3bfff640 1 --2- 172.21.15.106:0/3415686628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f440b0ac0 0x7f4f440afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f488b1640 1 -- 172.21.15.106:0/3415686628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f440b0ac0 msgr2=0x7f4f440afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f488b1640 1 --2- 172.21.15.106:0/3415686628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f440b0ac0 0x7f4f440afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f488b1640 1 -- 172.21.15.106:0/3415686628 >> v1:172.21.15.171:6789/0 conn(0x7f4f4409fb60 legacy=0x7f4f44144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.890+0000 7f4f488b1640 1 -- 172.21.15.106:0/3415686628 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f440b5b10 con 0x7f4f440679d0 2024-04-16T12:58:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f488b1640 1 --2- 172.21.15.106:0/3415686628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f440b4a80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009e50 tx=0x7f4f4002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d70fe7fb511bda server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f3b7fe640 1 -- 172.21.15.106:0/3415686628 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4002cb00 con 0x7f4f440679d0 2024-04-16T12:58:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f3b7fe640 1 -- 172.21.15.106:0/3415686628 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4002cca0 con 0x7f4f440679d0 2024-04-16T12:58:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f3b7fe640 1 -- 172.21.15.106:0/3415686628 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40034610 con 0x7f4f440679d0 2024-04-16T12:58:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f4ab15640 1 -- 172.21.15.106:0/3415686628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 msgr2=0x7f4f440b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/3415686628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f440b4a80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009e50 tx=0x7f4f4002bf60 comp rx=0 tx=0).stop 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f4ab15640 1 -- 172.21.15.106:0/3415686628 shutdown_connections 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/3415686628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f440b0ac0 0x7f4f440afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/3415686628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f440b4a80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.891+0000 7f4f4ab15640 1 -- 172.21.15.106:0/3415686628 >> 172.21.15.106:0/3415686628 conn(0x7f4f440b9ca0 msgr2=0x7f4f440ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.892+0000 7f4f4ab15640 1 -- 172.21.15.106:0/3415686628 shutdown_connections 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.892+0000 7f4f4ab15640 1 -- 172.21.15.106:0/3415686628 wait complete. 2024-04-16T12:58:10.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.892+0000 7f4f4ab15640 1 Processor -- start 2024-04-16T12:58:10.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f4ab15640 1 -- start start 2024-04-16T12:58:10.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f4ab15640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f44146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f4ab15640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f4409fb60 0x7f4f441427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f4ab15640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f440b0ac0 0x7f4f440b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f4ab15640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4f44145450 con 0x7f4f440679d0 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f4ab15640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4f440b57d0 con 0x7f4f440b0ac0 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f4ab15640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f441455d0 con 0x7f4f4409fb60 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f488b1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f44146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f488b1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f44146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38940/0 (socket says 172.21.15.106:38940) 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.893+0000 7f4f488b1640 1 -- 172.21.15.106:0/2147360687 learned_addr learned my addr 172.21.15.106:0/2147360687 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:10.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f3bfff640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f4409fb60 0x7f4f441427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f490b2640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f440b0ac0 0x7f4f440b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f488b1640 1 -- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f4409fb60 msgr2=0x7f4f441427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f488b1640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f4409fb60 0x7f4f441427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f488b1640 1 -- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f440b0ac0 msgr2=0x7f4f440b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f488b1640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f440b0ac0 0x7f4f440b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f488b1640 1 -- 172.21.15.106:0/2147360687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f44147170 con 0x7f4f440679d0 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f3bfff640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f4409fb60 0x7f4f441427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:10.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f490b2640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f440b0ac0 0x7f4f440b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f488b1640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f44146060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009f70 tx=0x7f4f40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f397fa640 1 -- 172.21.15.106:0/2147360687 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40043020 con 0x7f4f440679d0 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f397fa640 1 -- 172.21.15.106:0/2147360687 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4002ce50 con 0x7f4f440679d0 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f441e1090 con 0x7f4f440679d0 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f397fa640 1 -- 172.21.15.106:0/2147360687 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40009510 con 0x7f4f440679d0 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.894+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f441e1b70 con 0x7f4f440679d0 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.895+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f44068a90 con 0x7f4f440679d0 2024-04-16T12:58:10.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.896+0000 7f4f397fa640 1 -- 172.21.15.106:0/2147360687 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f40046020 con 0x7f4f440679d0 2024-04-16T12:58:10.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.896+0000 7f4f397fa640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4f3006c920 0x7f4f3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:10.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.896+0000 7f4f397fa640 1 -- 172.21.15.106:0/2147360687 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f4f400ae130 con 0x7f4f440679d0 2024-04-16T12:58:10.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.896+0000 7f4f3bfff640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4f3006c920 0x7f4f3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:10.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.896+0000 7f4f3bfff640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4f3006c920 0x7f4f3006ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f34006fd0 tx=0x7f4f34008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:10.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:10.900+0000 7f4f397fa640 1 -- 172.21.15.106:0/2147360687 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f4004d030 con 0x7f4f440679d0 2024-04-16T12:58:11.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.078+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4f44072540 con 0x7f4f3006c920 2024-04-16T12:58:11.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.078+0000 7f4f397fa640 1 -- 172.21.15.106:0/2147360687 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f44072540 con 0x7f4f3006c920 2024-04-16T12:58:11.081 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 1 to deep-scrub 2024-04-16T12:58:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4f3006c920 msgr2=0x7f4f3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4f3006c920 0x7f4f3006ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f34006fd0 tx=0x7f4f34008040 comp rx=0 tx=0).stop 2024-04-16T12:58:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 msgr2=0x7f4f44146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f44146060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009f70 tx=0x7f4f40004a40 comp rx=0 tx=0).stop 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 shutdown_connections 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f4f3006c920 0x7f4f3006ede0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f440b0ac0 0x7f4f440b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f4409fb60 0x7f4f441427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 --2- 172.21.15.106:0/2147360687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f440679d0 0x7f4f44146060 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 >> 172.21.15.106:0/2147360687 conn(0x7f4f440b9ca0 msgr2=0x7f4f440b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 shutdown_connections 2024-04-16T12:58:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.080+0000 7f4f4ab15640 1 -- 172.21.15.106:0/2147360687 wait complete. 2024-04-16T12:58:11.094 INFO:tasks.ceph:Scrubbing osd.2 2024-04-16T12:58:11.094 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:11.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.200+0000 7ffb90d00640 1 Processor -- start 2024-04-16T12:58:11.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.200+0000 7ffb90d00640 1 -- start start 2024-04-16T12:58:11.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb90d00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffb8c09b560 0x7ffb8c1443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb90d00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffb8c09ed40 0x7ffb8c14ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb90d00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c06ec00 con 0x7ffb8c144900 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb90d00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8c0ae580 con 0x7ffb8c09b560 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb90d00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8c09b940 con 0x7ffb8c09ed40 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8a59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffb8c09b560 0x7ffb8c1443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8a59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffb8c09b560 0x7ffb8c1443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38946/0 (socket says 172.21.15.106:38946) 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8a59c640 1 -- 172.21.15.106:0/634853885 learned_addr learned my addr 172.21.15.106:0/634853885 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8ad9d640 1 --2- 172.21.15.106:0/634853885 >> v2:172.21.15.171:3300/0 conn(0x7ffb8c09ed40 0x7ffb8c14ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8a59c640 1 -- 172.21.15.106:0/634853885 >> v2:172.21.15.171:3300/0 conn(0x7ffb8c09ed40 msgr2=0x7ffb8c14ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8a59c640 1 --2- 172.21.15.106:0/634853885 >> v2:172.21.15.171:3300/0 conn(0x7ffb8c09ed40 0x7ffb8c14ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8a59c640 1 -- 172.21.15.106:0/634853885 >> v1:172.21.15.171:6789/0 conn(0x7ffb8c144900 legacy=0x7ffb8c09e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.201+0000 7ffb8a59c640 1 -- 172.21.15.106:0/634853885 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c0af8f0 con 0x7ffb8c09b560 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.202+0000 7ffb8a59c640 1 --2- 172.21.15.106:0/634853885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c1443c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06e240 tx=0x7ffb7c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833b60dbd1bca41a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.202+0000 7ffb8959a640 1 -- 172.21.15.106:0/634853885 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c038070 con 0x7ffb8c09b560 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.202+0000 7ffb8959a640 1 -- 172.21.15.106:0/634853885 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7c02f050 con 0x7ffb8c09b560 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.202+0000 7ffb8959a640 1 -- 172.21.15.106:0/634853885 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c031970 con 0x7ffb8c09b560 2024-04-16T12:58:11.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 -- 172.21.15.106:0/634853885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 msgr2=0x7ffb8c1443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 --2- 172.21.15.106:0/634853885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c1443c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06e240 tx=0x7ffb7c02b7f0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 -- 172.21.15.106:0/634853885 shutdown_connections 2024-04-16T12:58:11.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 --2- 172.21.15.106:0/634853885 >> v2:172.21.15.171:3300/0 conn(0x7ffb8c09ed40 0x7ffb8c14ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 --2- 172.21.15.106:0/634853885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c1443c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 -- 172.21.15.106:0/634853885 >> 172.21.15.106:0/634853885 conn(0x7ffb8c0b5e30 msgr2=0x7ffb8c0b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 -- 172.21.15.106:0/634853885 shutdown_connections 2024-04-16T12:58:11.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.203+0000 7ffb90d00640 1 -- 172.21.15.106:0/634853885 wait complete. 2024-04-16T12:58:11.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.204+0000 7ffb90d00640 1 Processor -- start 2024-04-16T12:58:11.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.204+0000 7ffb90d00640 1 -- start start 2024-04-16T12:58:11.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c13a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb8c09ed40 0x7ffb8c1df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb8c144900 0x7ffb8c1df600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c0af550 con 0x7ffb8c09b560 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c09bf00 con 0x7ffb8c09ed40 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8c0af6d0 con 0x7ffb8c144900 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c13a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38958/0 (socket says 172.21.15.106:38958) 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 -- 172.21.15.106:0/3792757536 learned_addr learned my addr 172.21.15.106:0/3792757536 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb89d9b640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb8c09ed40 0x7ffb8c1df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8ad9d640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb8c144900 0x7ffb8c1df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 -- 172.21.15.106:0/3792757536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb8c144900 msgr2=0x7ffb8c1df600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb8c144900 0x7ffb8c1df600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 -- 172.21.15.106:0/3792757536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb8c09ed40 msgr2=0x7ffb8c1df0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb8c09ed40 0x7ffb8c1df0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 -- 172.21.15.106:0/3792757536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c13ba70 con 0x7ffb8c09b560 2024-04-16T12:58:11.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb8a59c640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c13a440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c000c00 tx=0x7ffb7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c042070 con 0x7ffb8c09b560 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7c03d870 con 0x7ffb8c09b560 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c038040 con 0x7ffb8c09b560 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c138e50 con 0x7ffb8c09b560 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.205+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8c1390f0 con 0x7ffb8c09b560 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.206+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb8c068a90 con 0x7ffb8c09b560 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.207+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb7c045070 con 0x7ffb8c09b560 2024-04-16T12:58:11.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.207+0000 7ffb7affd640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffb6c06c920 0x7ffb6c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.207+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7ffb7c0ad840 con 0x7ffb8c09b560 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.207+0000 7ffb89d9b640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffb6c06c920 0x7ffb6c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.207+0000 7ffb7affd640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7ffb6c074ac0 0x7ffb6c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.207+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 --> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb7c04ce80 con 0x7ffb6c074ac0 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.207+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb7c0b22c0 con 0x7ffb8c09b560 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.208+0000 7ffb8ad9d640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7ffb6c074ac0 0x7ffb6c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.208+0000 7ffb89d9b640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffb6c06c920 0x7ffb6c06ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c1dea60 tx=0x7ffb80009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.208+0000 7ffb8ad9d640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7ffb6c074ac0 0x7ffb6c076ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.208+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== osd.2 v2:172.21.15.106:6824/2939840684 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb7c04ce80 con 0x7ffb6c074ac0 2024-04-16T12:58:11.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.221+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 --> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb8c09c610 con 0x7ffb6c074ac0 2024-04-16T12:58:11.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb7affd640 1 -- 172.21.15.106:0/3792757536 <== osd.2 v2:172.21.15.106:6824/2939840684 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb8c09c610 con 0x7ffb6c074ac0 2024-04-16T12:58:11.224 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:11.225 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:11.225 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7ffb6c074ac0 msgr2=0x7ffb6c076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6824/2939840684,v1:172.21.15.106:6825/2939840684] conn(0x7ffb6c074ac0 0x7ffb6c076ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffb6c06c920 msgr2=0x7ffb6c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7ffb6c06c920 0x7ffb6c06ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c1dea60 tx=0x7ffb80009060 comp rx=0 tx=0).stop 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 msgr2=0x7ffb8c13a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 --2- 172.21.15.106:0/3792757536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb8c09b560 0x7ffb8c13a440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c000c00 tx=0x7ffb7c0046c0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb8ad9d640 1 -- 172.21.15.106:0/3792757536 reap_dead start 2024-04-16T12:58:11.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 shutdown_connections 2024-04-16T12:58:11.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 >> 172.21.15.106:0/3792757536 conn(0x7ffb8c0b5e30 msgr2=0x7ffb8c0b7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 shutdown_connections 2024-04-16T12:58:11.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.222+0000 7ffb90d00640 1 -- 172.21.15.106:0/3792757536 wait complete. 2024-04-16T12:58:11.235 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-16T12:58:11.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.335+0000 7f60cbe47640 1 Processor -- start 2024-04-16T12:58:11.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.335+0000 7f60cbe47640 1 -- start start 2024-04-16T12:58:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60cbe47640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 0x7f60c41418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60cbe47640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c41488d0 con 0x7f60c40b63a0 2024-04-16T12:58:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60cbe47640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c4148b70 con 0x7f60c4141de0 2024-04-16T12:58:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60cbe47640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f60c40b4bd0 con 0x7f60c40b6780 2024-04-16T12:58:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60c9be3640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f60c40b63a0 0x7f60c41481c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43024/0 (socket says 172.21.15.106:43024) 2024-04-16T12:58:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60c9be3640 1 -- 172.21.15.106:0/3495848249 learned_addr learned my addr 172.21.15.106:0/3495848249 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60c93e2640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 0x7f60c41418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168492018 0 0) 0x7f60c41488d0 con 0x7f60c40b63a0 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.336+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60b0003520 con 0x7f60c40b63a0 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366815736 0 0) 0x7f60c4148b70 con 0x7f60c4141de0 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60c41488d0 con 0x7f60c4141de0 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 919376346 0 0) 0x7f60b0003520 con 0x7f60c40b63a0 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 msgr2=0x7f60c41418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 0x7f60c41418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 >> v1:172.21.15.171:6789/0 conn(0x7f60c4141de0 legacy=0x7f60c40b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c40b4eb0 con 0x7f60c40b63a0 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f60bc001970 con 0x7f60c40b63a0 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 >> v1:172.21.15.106:6789/0 conn(0x7f60c40b63a0 legacy=0x7f60c41481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60b0003b70 0x7f60b0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 0x7f60b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b0004d40 0x7f60b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f60c40b4bd0 con 0x7f60b0003b70 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f60b000bb50 con 0x7f60b0004d40 2024-04-16T12:58:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f60b000bd50 con 0x7f60c40b6780 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c9be3640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60b0003b70 0x7f60b0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c93e2640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 0x7f60b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60ca3e4640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b0004d40 0x7f60b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c9be3640 1 -- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 msgr2=0x7f60b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c9be3640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60c40b6780 0x7f60b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c9be3640 1 -- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b0004d40 msgr2=0x7f60b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c9be3640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b0004d40 0x7f60b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.337+0000 7f60c9be3640 1 -- 172.21.15.106:0/3495848249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b0003520 con 0x7f60b0003b70 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.338+0000 7f60c9be3640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60b0003b70 0x7f60b0003f70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00a6d0 tx=0x7f60b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0118c0dbfc9d47 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.338+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00a2f0 con 0x7f60b0003b70 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.338+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60bc007350 con 0x7f60b0003b70 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.338+0000 7f60c8be1640 1 -- 172.21.15.106:0/3495848249 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc007780 con 0x7f60b0003b70 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.339+0000 7f60cbe47640 1 -- 172.21.15.106:0/3495848249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60b0003b70 msgr2=0x7f60b0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.339+0000 7f60cbe47640 1 --2- 172.21.15.106:0/3495848249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60b0003b70 0x7f60b0003f70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00a6d0 tx=0x7f60b0005830 comp rx=0 tx=0).stop 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.339+0000 7f60ca3e4640 1 -- 172.21.15.106:0/3495848249 reap_dead start 2024-04-16T12:58:11.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.339+0000 7f60cbe47640 1 -- 172.21.15.106:0/3495848249 shutdown_connections 2024-04-16T12:58:11.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.339+0000 7f60cbe47640 1 -- 172.21.15.106:0/3495848249 >> 172.21.15.106:0/3495848249 conn(0x7f60c4068080 msgr2=0x7f60c40bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.339+0000 7f60cbe47640 1 -- 172.21.15.106:0/3495848249 shutdown_connections 2024-04-16T12:58:11.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.339+0000 7f60cbe47640 1 -- 172.21.15.106:0/3495848249 wait complete. 2024-04-16T12:58:11.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.340+0000 7f60cbe47640 1 Processor -- start 2024-04-16T12:58:11.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.340+0000 7f60cbe47640 1 -- start start 2024-04-16T12:58:11.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.340+0000 7f60cbe47640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b0003b70 0x7f60c413f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60cbe47640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60c4143af0 0x7f60c4143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60cbe47640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c413b670 0x7f60c413bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60cbe47640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f60c41418a0 con 0x7f60c413b670 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60cbe47640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f60c40b5cf0 con 0x7f60c4143af0 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60cbe47640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f60c4141a20 con 0x7f60b0003b70 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c413b670 0x7f60c413bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c413b670 0x7f60c413bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38976/0 (socket says 172.21.15.106:38976) 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 -- 172.21.15.106:0/3238762803 learned_addr learned my addr 172.21.15.106:0/3238762803 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60c9be3640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b0003b70 0x7f60c413f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60c93e2640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60c4143af0 0x7f60c4143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 -- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b0003b70 msgr2=0x7f60c413f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b0003b70 0x7f60c413f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 -- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60c4143af0 msgr2=0x7f60c4143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60c4143af0 0x7f60c4143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 -- 172.21.15.106:0/3238762803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c41444b0 con 0x7f60c413b670 2024-04-16T12:58:11.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ca3e4640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c413b670 0x7f60c413bab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f60c40b9b40 tx=0x7f60c000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ba7fc640 1 -- 172.21.15.106:0/3238762803 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0019070 con 0x7f60c413b670 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ba7fc640 1 -- 172.21.15.106:0/3238762803 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c00050d0 con 0x7f60c413b670 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60ba7fc640 1 -- 172.21.15.106:0/3238762803 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c00069e0 con 0x7f60c413b670 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c4144fc0 con 0x7f60c413b670 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.341+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c4140160 con 0x7f60c413b670 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.342+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c4068a90 con 0x7f60c413b670 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.343+0000 7f60ba7fc640 1 -- 172.21.15.106:0/3238762803 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f60c001c070 con 0x7f60c413b670 2024-04-16T12:58:11.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.343+0000 7f60ba7fc640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f60a806c8f0 0x7f60a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.343+0000 7f60c9be3640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f60a806c8f0 0x7f60a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.343+0000 7f60ba7fc640 1 -- 172.21.15.106:0/3238762803 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f60c008ad30 con 0x7f60c413b670 2024-04-16T12:58:11.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.344+0000 7f60c9be3640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f60a806c8f0 0x7f60a806edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00a6d0 tx=0x7f60bc02f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.348+0000 7f60ba7fc640 1 -- 172.21.15.106:0/3238762803 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f60c41444b0 con 0x7f60c413b670 2024-04-16T12:58:11.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.525+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f60c41ceb40 con 0x7f60a806c8f0 2024-04-16T12:58:11.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.526+0000 7f60ba7fc640 1 -- 172.21.15.106:0/3238762803 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60c41ceb40 con 0x7f60a806c8f0 2024-04-16T12:58:11.529 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 2 to deep-scrub 2024-04-16T12:58:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f60a806c8f0 msgr2=0x7f60a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f60a806c8f0 0x7f60a806edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00a6d0 tx=0x7f60bc02f000 comp rx=0 tx=0).stop 2024-04-16T12:58:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c413b670 msgr2=0x7f60c413bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c413b670 0x7f60c413bab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f60c40b9b40 tx=0x7f60c000fc00 comp rx=0 tx=0).stop 2024-04-16T12:58:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 shutdown_connections 2024-04-16T12:58:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f60a806c8f0 0x7f60a806edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c413b670 0x7f60c413bab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60c4143af0 0x7f60c4143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 --2- 172.21.15.106:0/3238762803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b0003b70 0x7f60c413f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 >> 172.21.15.106:0/3238762803 conn(0x7f60c4068080 msgr2=0x7f60c40bc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 shutdown_connections 2024-04-16T12:58:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.528+0000 7f60cbe47640 1 -- 172.21.15.106:0/3238762803 wait complete. 2024-04-16T12:58:11.541 INFO:tasks.ceph:Scrubbing osd.3 2024-04-16T12:58:11.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:11.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.645+0000 7fecc5dcd640 1 Processor -- start 2024-04-16T12:58:11.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.645+0000 7fecc5dcd640 1 -- start start 2024-04-16T12:58:11.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecc5dcd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc009acd0 0x7fecc0148800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecc5dcd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc009b0b0 con 0x7fecc0148d40 2024-04-16T12:58:11.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecc5dcd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc006e5c0 con 0x7fecc009de50 2024-04-16T12:58:11.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecc5dcd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fecc009b670 con 0x7fecc009acd0 2024-04-16T12:58:11.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbeffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fecc0148d40 0x7fecc009d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43038/0 (socket says 172.21.15.106:43038) 2024-04-16T12:58:11.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbeffd640 1 -- 172.21.15.106:0/1851518775 learned_addr learned my addr 172.21.15.106:0/1851518775 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:11.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc009acd0 0x7fecc0148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939166741 0 0) 0x7fecc009b0b0 con 0x7fecc0148d40 2024-04-16T12:58:11.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feca8003520 con 0x7fecc0148d40 2024-04-16T12:58:11.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365388909 0 0) 0x7fecc006e5c0 con 0x7fecc009de50 2024-04-16T12:58:11.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc009b0b0 con 0x7fecc009de50 2024-04-16T12:58:11.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3411556261 0 0) 0x7feca8003520 con 0x7fecc0148d40 2024-04-16T12:58:11.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc009acd0 msgr2=0x7fecc0148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc009acd0 0x7fecc0148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 >> v1:172.21.15.171:6789/0 conn(0x7fecc009de50 legacy=0x7fecc0150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc009b950 con 0x7fecc0148d40 2024-04-16T12:58:11.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7fecb4001670 con 0x7fecc0148d40 2024-04-16T12:58:11.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 >> v1:172.21.15.106:6789/0 conn(0x7fecc0148d40 legacy=0x7fecc009d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca8003b70 0x7feca8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feca8004800 0x7feca8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca80051c0 0x7feca800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fecc009b670 con 0x7feca8003b70 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feca800c0f0 con 0x7feca80051c0 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feca800c2f0 con 0x7feca8004800 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.646+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc009acd0 0x7fecc0148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbffff640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca80051c0 0x7feca800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca8003b70 0x7feca8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbeffd640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feca8004800 0x7feca8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbf7fe640 1 -- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feca8004800 msgr2=0x7feca8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feca8004800 0x7feca8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbf7fe640 1 -- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca80051c0 msgr2=0x7feca800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca80051c0 0x7feca800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbf7fe640 1 -- 172.21.15.106:0/1851518775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca8003520 con 0x7feca8003b70 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.647+0000 7fecbffff640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca80051c0 0x7feca800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca8003b70 0x7feca8003f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fecc00ba290 tx=0x7feca8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2edde2051705028 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb00097d0 con 0x7feca8003b70 2024-04-16T12:58:11.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb0004030 con 0x7feca8003b70 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecbe7fc640 1 -- 172.21.15.106:0/1851518775 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0004400 con 0x7feca8003b70 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecc5dcd640 1 -- 172.21.15.106:0/1851518775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca8003b70 msgr2=0x7feca8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecc5dcd640 1 --2- 172.21.15.106:0/1851518775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca8003b70 0x7feca8003f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fecc00ba290 tx=0x7feca8005830 comp rx=0 tx=0).stop 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecbffff640 1 -- 172.21.15.106:0/1851518775 reap_dead start 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecc5dcd640 1 -- 172.21.15.106:0/1851518775 shutdown_connections 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecc5dcd640 1 -- 172.21.15.106:0/1851518775 >> 172.21.15.106:0/1851518775 conn(0x7fecc00b5e30 msgr2=0x7fecc00b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecc5dcd640 1 -- 172.21.15.106:0/1851518775 shutdown_connections 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.648+0000 7fecc5dcd640 1 -- 172.21.15.106:0/1851518775 wait complete. 2024-04-16T12:58:11.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.649+0000 7fecc5dcd640 1 Processor -- start 2024-04-16T12:58:11.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.649+0000 7fecc5dcd640 1 -- start start 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecc5dcd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca8003b70 0x7fecc006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecc5dcd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc0143fe0 0x7fecc013a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecc5dcd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecc00ae350 0x7fecc01e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecc5dcd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fecc00b5930 con 0x7fecc00ae350 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecc5dcd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fecc00b5180 con 0x7feca8003b70 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecc5dcd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fecc00b5ab0 con 0x7fecc0143fe0 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecc00ae350 0x7fecc01e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecc00ae350 0x7fecc01e15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38998/0 (socket says 172.21.15.106:38998) 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 -- 172.21.15.106:0/525684626 learned_addr learned my addr 172.21.15.106:0/525684626 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca8003b70 0x7fecc006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbeffd640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc0143fe0 0x7fecc013a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 -- 172.21.15.106:0/525684626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc0143fe0 msgr2=0x7fecc013a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc0143fe0 0x7fecc013a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 -- 172.21.15.106:0/525684626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca8003b70 msgr2=0x7fecc006d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca8003b70 0x7fecc006d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbffff640 1 -- 172.21.15.106:0/525684626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc00aebd0 con 0x7fecc00ae350 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.650+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feca8003b70 0x7fecc006d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.651+0000 7fecbffff640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecc00ae350 0x7fecc01e15e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fecc009f680 tx=0x7fecb800ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.651+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8001bf0 con 0x7fecc00ae350 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.651+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8018070 con 0x7fecc00ae350 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.651+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8003dc0 con 0x7fecc00ae350 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.651+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc00aeeb0 con 0x7fecc00ae350 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.651+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc006db80 con 0x7fecc00ae350 2024-04-16T12:58:11.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.652+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecc0068a90 con 0x7fecc00ae350 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.652+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecb800d860 con 0x7fecc00ae350 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7feca7fff640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fecac06c920 0x7fecac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fecb808b690 con 0x7fecc00ae350 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fecac06c920 0x7fecac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7feca7fff640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7fecac074b20 0x7fecac076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 --> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecb8020ec0 con 0x7fecac074b20 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fecb8092050 con 0x7fecc00ae350 2024-04-16T12:58:11.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7fecbeffd640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7fecac074b20 0x7fecac076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7fecbf7fe640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fecac06c920 0x7fecac06ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecb0035000 tx=0x7fecb0030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.653+0000 7fecbeffd640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7fecac074b20 0x7fecac076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.654+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== osd.3 v2:172.21.15.106:6816/2118469111 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecb8020ec0 con 0x7fecac074b20 2024-04-16T12:58:11.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 --> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fecc00ae7d0 con 0x7fecac074b20 2024-04-16T12:58:11.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7feca7fff640 1 -- 172.21.15.106:0/525684626 <== osd.3 v2:172.21.15.106:6816/2118469111 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fecc00ae7d0 con 0x7fecac074b20 2024-04-16T12:58:11.670 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:11.670 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:11.670 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:11.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7fecac074b20 msgr2=0x7fecac076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6816/2118469111,v1:172.21.15.106:6817/2118469111] conn(0x7fecac074b20 0x7fecac076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fecac06c920 msgr2=0x7fecac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fecac06c920 0x7fecac06ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecb0035000 tx=0x7fecb0030000 comp rx=0 tx=0).stop 2024-04-16T12:58:11.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecc00ae350 msgr2=0x7fecc01e15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 --2- 172.21.15.106:0/525684626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecc00ae350 0x7fecc01e15e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fecc009f680 tx=0x7fecb800ff50 comp rx=0 tx=0).stop 2024-04-16T12:58:11.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecbffff640 1 -- 172.21.15.106:0/525684626 reap_dead start 2024-04-16T12:58:11.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 shutdown_connections 2024-04-16T12:58:11.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 >> 172.21.15.106:0/525684626 conn(0x7fecc00b5e30 msgr2=0x7fecc00b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 shutdown_connections 2024-04-16T12:58:11.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.667+0000 7fecc5dcd640 1 -- 172.21.15.106:0/525684626 wait complete. 2024-04-16T12:58:11.680 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-16T12:58:11.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.781+0000 7f82b44c8640 1 Processor -- start 2024-04-16T12:58:11.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.781+0000 7f82b44c8640 1 -- start start 2024-04-16T12:58:11.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b44c8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f82ac06db00 0x7f82ac0b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b44c8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f82ac1481b0 0x7f82ac148620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b44c8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0b44c0 con 0x7f82ac148b60 2024-04-16T12:58:11.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b44c8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac0ae4c0 con 0x7f82ac06db00 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b44c8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac06dee0 con 0x7f82ac1481b0 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b2264640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f82ac06db00 0x7f82ac0b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b2a65640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f82ac148b60 0x7f82ac144080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43048/0 (socket says 172.21.15.106:43048) 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b2a65640 1 -- 172.21.15.106:0/1941127966 learned_addr learned my addr 172.21.15.106:0/1941127966 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b1a63640 1 --2- 172.21.15.106:0/1941127966 >> v2:172.21.15.171:3300/0 conn(0x7f82ac1481b0 0x7f82ac148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b2264640 1 -- 172.21.15.106:0/1941127966 >> v2:172.21.15.171:3300/0 conn(0x7f82ac1481b0 msgr2=0x7f82ac148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b2264640 1 --2- 172.21.15.106:0/1941127966 >> v2:172.21.15.171:3300/0 conn(0x7f82ac1481b0 0x7f82ac148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b2264640 1 -- 172.21.15.106:0/1941127966 >> v1:172.21.15.106:6789/0 conn(0x7f82ac148b60 legacy=0x7f82ac144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b2264640 1 -- 172.21.15.106:0/1941127966 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0b5620 con 0x7f82ac06db00 2024-04-16T12:58:11.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b1262640 1 -- 172.21.15.106:0/1941127966 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658832572 0 0) 0x7f82a4001490 con 0x7f82ac148b60 2024-04-16T12:58:11.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.782+0000 7f82b1a63640 1 --2- 172.21.15.106:0/1941127966 >> v2:172.21.15.171:3300/0 conn(0x7f82ac1481b0 0x7f82ac148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:11.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.783+0000 7f82b2264640 1 --2- 172.21.15.106:0/1941127966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac06db00 0x7f82ac0b3ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0b6870 tx=0x7f82a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19d33e5c90275dd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.783+0000 7f82b1262640 1 -- 172.21.15.106:0/1941127966 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a80315a0 con 0x7f82ac06db00 2024-04-16T12:58:11.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.783+0000 7f82b1262640 1 -- 172.21.15.106:0/1941127966 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a8037070 con 0x7f82ac06db00 2024-04-16T12:58:11.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.783+0000 7f82b1262640 1 -- 172.21.15.106:0/1941127966 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8031960 con 0x7f82ac06db00 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.783+0000 7f82b44c8640 1 -- 172.21.15.106:0/1941127966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac06db00 msgr2=0x7f82ac0b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.783+0000 7f82b44c8640 1 --2- 172.21.15.106:0/1941127966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac06db00 0x7f82ac0b3ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0b6870 tx=0x7f82a802b840 comp rx=0 tx=0).stop 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.784+0000 7f82b44c8640 1 -- 172.21.15.106:0/1941127966 shutdown_connections 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.784+0000 7f82b44c8640 1 --2- 172.21.15.106:0/1941127966 >> v2:172.21.15.171:3300/0 conn(0x7f82ac1481b0 0x7f82ac148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.784+0000 7f82b44c8640 1 --2- 172.21.15.106:0/1941127966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac06db00 0x7f82ac0b3ea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.784+0000 7f82b44c8640 1 -- 172.21.15.106:0/1941127966 >> 172.21.15.106:0/1941127966 conn(0x7f82ac09cc10 msgr2=0x7f82ac06d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.784+0000 7f82b44c8640 1 -- 172.21.15.106:0/1941127966 shutdown_connections 2024-04-16T12:58:11.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.784+0000 7f82b44c8640 1 -- 172.21.15.106:0/1941127966 wait complete. 2024-04-16T12:58:11.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 Processor -- start 2024-04-16T12:58:11.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 -- start start 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac06db00 0x7f82ac073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac1481b0 0x7f82ac1d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac148b60 0x7f82ac1dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0b5100 con 0x7f82ac148b60 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0b4e20 con 0x7f82ac1481b0 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b44c8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac148f70 con 0x7f82ac06db00 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b2a65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac148b60 0x7f82ac1dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b2a65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac148b60 0x7f82ac1dd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39024/0 (socket says 172.21.15.106:39024) 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b2a65640 1 -- 172.21.15.106:0/3993376755 learned_addr learned my addr 172.21.15.106:0/3993376755 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b1a63640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac1481b0 0x7f82ac1d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.785+0000 7f82b2264640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac06db00 0x7f82ac073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b2a65640 1 -- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac06db00 msgr2=0x7f82ac073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b2a65640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac06db00 0x7f82ac073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b2a65640 1 -- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac1481b0 msgr2=0x7f82ac1d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b2a65640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac1481b0 0x7f82ac1d24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b2a65640 1 -- 172.21.15.106:0/3993376755 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0af320 con 0x7f82ac148b60 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b2a65640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac148b60 0x7f82ac1dd9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c730 tx=0x7f82a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82a2ffd640 1 -- 172.21.15.106:0/3993376755 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4018070 con 0x7f82ac148b60 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82a2ffd640 1 -- 172.21.15.106:0/3993376755 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a400ce40 con 0x7f82ac148b60 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac0af600 con 0x7f82ac148b60 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82a2ffd640 1 -- 172.21.15.106:0/3993376755 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a400a860 con 0x7f82ac148b60 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.786+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac072a90 con 0x7f82ac148b60 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.787+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ac068a90 con 0x7f82ac148b60 2024-04-16T12:58:11.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.787+0000 7f82a2ffd640 1 -- 172.21.15.106:0/3993376755 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82a401b070 con 0x7f82ac148b60 2024-04-16T12:58:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.788+0000 7f82a2ffd640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f829006c920 0x7f829006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.788+0000 7f82b2264640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f829006c920 0x7f829006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.788+0000 7f82a2ffd640 1 -- 172.21.15.106:0/3993376755 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f82a408b0b0 con 0x7f82ac148b60 2024-04-16T12:58:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.788+0000 7f82b2264640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f829006c920 0x7f829006ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82a8036000 tx=0x7f82a8008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:11.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.792+0000 7f82a2ffd640 1 -- 172.21.15.106:0/3993376755 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f82ac0b44c0 con 0x7f82ac148b60 2024-04-16T12:58:11.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.968+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f82ac06cab0 con 0x7f829006c920 2024-04-16T12:58:11.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.969+0000 7f82a2ffd640 1 -- 172.21.15.106:0/3993376755 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f82ac06cab0 con 0x7f829006c920 2024-04-16T12:58:11.972 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 3 to deep-scrub 2024-04-16T12:58:11.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.970+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f829006c920 msgr2=0x7f829006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.970+0000 7f82b44c8640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f829006c920 0x7f829006ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82a8036000 tx=0x7f82a8008030 comp rx=0 tx=0).stop 2024-04-16T12:58:11.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.970+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac148b60 msgr2=0x7f82ac1dd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:11.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.970+0000 7f82b44c8640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac148b60 0x7f82ac1dd9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c730 tx=0x7f82a400cbf0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 shutdown_connections 2024-04-16T12:58:11.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f829006c920 0x7f829006ede0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82ac148b60 0x7f82ac1dd9a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac1481b0 0x7f82ac1d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 --2- 172.21.15.106:0/3993376755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac06db00 0x7f82ac073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:11.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 >> 172.21.15.106:0/3993376755 conn(0x7f82ac09cc10 msgr2=0x7f82ac0b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:11.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 shutdown_connections 2024-04-16T12:58:11.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:11.971+0000 7f82b44c8640 1 -- 172.21.15.106:0/3993376755 wait complete. 2024-04-16T12:58:11.984 INFO:tasks.ceph:Scrubbing osd.4 2024-04-16T12:58:11.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:12.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.088+0000 7fe20170d640 1 Processor -- start 2024-04-16T12:58:12.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.088+0000 7fe20170d640 1 -- start start 2024-04-16T12:58:12.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe20170d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe1fc14c100 0x7fe1fc1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe20170d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc073fb0 con 0x7fe1fc0734c0 2024-04-16T12:58:12.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe20170d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc14b620 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe20170d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe1fc14b900 con 0x7fe1fc14c100 2024-04-16T12:58:12.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe1fb7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe1fc14c100 0x7fe1fc1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe1faffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe1fc0734c0 0x7fe1fc147f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43058/0 (socket says 172.21.15.106:43058) 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe1faffd640 1 -- 172.21.15.106:0/2258799057 learned_addr learned my addr 172.21.15.106:0/2258799057 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe1fb7fe640 1 -- 172.21.15.106:0/2258799057 >> v1:172.21.15.171:6789/0 conn(0x7fe1fc06f5f0 legacy=0x7fe1fc0738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe1fb7fe640 1 -- 172.21.15.106:0/2258799057 >> v1:172.21.15.106:6789/0 conn(0x7fe1fc0734c0 legacy=0x7fe1fc147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe1fb7fe640 1 -- 172.21.15.106:0/2258799057 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc14bbe0 con 0x7fe1fc14c100 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.089+0000 7fe1f9ffb640 1 -- 172.21.15.106:0/2258799057 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775204928 0 0) 0x7fe1fc073fb0 con 0x7fe1fc0734c0 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.090+0000 7fe1fb7fe640 1 --2- 172.21.15.106:0/2258799057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc14c100 0x7fe1fc1450b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009d90 tx=0x7fe1f402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998d0a0e0eec7b18 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.090+0000 7fe1f9ffb640 1 -- 172.21.15.106:0/2258799057 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4039070 con 0x7fe1fc14c100 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.090+0000 7fe1f9ffb640 1 -- 172.21.15.106:0/2258799057 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f402cbd0 con 0x7fe1fc14c100 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.090+0000 7fe1f9ffb640 1 -- 172.21.15.106:0/2258799057 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4034440 con 0x7fe1fc14c100 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.091+0000 7fe20170d640 1 -- 172.21.15.106:0/2258799057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc14c100 msgr2=0x7fe1fc1450b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.091+0000 7fe20170d640 1 --2- 172.21.15.106:0/2258799057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc14c100 0x7fe1fc1450b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009d90 tx=0x7fe1f402be20 comp rx=0 tx=0).stop 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.091+0000 7fe20170d640 1 -- 172.21.15.106:0/2258799057 shutdown_connections 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.091+0000 7fe20170d640 1 --2- 172.21.15.106:0/2258799057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc14c100 0x7fe1fc1450b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.091+0000 7fe20170d640 1 -- 172.21.15.106:0/2258799057 >> 172.21.15.106:0/2258799057 conn(0x7fe1fc0b6f40 msgr2=0x7fe1fc0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.091+0000 7fe20170d640 1 -- 172.21.15.106:0/2258799057 shutdown_connections 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.091+0000 7fe20170d640 1 -- 172.21.15.106:0/2258799057 wait complete. 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.092+0000 7fe20170d640 1 Processor -- start 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.092+0000 7fe20170d640 1 -- start start 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc06f5f0 0x7fe1fc0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0734c0 0x7fe1fc1ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc14c100 0x7fe1fc1de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc145980 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc145800 con 0x7fe1fc14c100 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1fc153830 con 0x7fe1fc0734c0 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc06f5f0 0x7fe1fc0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc06f5f0 0x7fe1fc0b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39036/0 (socket says 172.21.15.106:39036) 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 -- 172.21.15.106:0/2728376978 learned_addr learned my addr 172.21.15.106:0/2728376978 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1fb7fe640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc14c100 0x7fe1fc1de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1fa7fc640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0734c0 0x7fe1fc1ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 -- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0734c0 msgr2=0x7fe1fc1ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1fc0734c0 0x7fe1fc1ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 -- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc14c100 msgr2=0x7fe1fc1de4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc14c100 0x7fe1fc1de4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 -- 172.21.15.106:0/2728376978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc0b2660 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1fb7fe640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1fc14c100 0x7fe1fc1de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1faffd640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc06f5f0 0x7fe1fc0b36c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c4a0 tx=0x7fe1ec00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec018070 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0074e0 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1fc0b2940 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec004a20 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.093+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1fc0b1410 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.094+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1fc09a320 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.095+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1ec01b070 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.095+0000 7fe1e37fe640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1e806c8f0 0x7fe1e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.095+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fe1ec08ae20 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.095+0000 7fe1fa7fc640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1e806c8f0 0x7fe1e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.095+0000 7fe1e37fe640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7fe1e8074af0 0x7fe1e8076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.095+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 --> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1e80775c0 con 0x7fe1e8074af0 2024-04-16T12:58:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.095+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1ec08d520 con 0x7fe1fc06f5f0 2024-04-16T12:58:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.096+0000 7fe1fb7fe640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7fe1e8074af0 0x7fe1e8076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.096+0000 7fe1fa7fc640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1e806c8f0 0x7fe1e806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b10d0 tx=0x7fe1f0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.096+0000 7fe1fb7fe640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7fe1e8074af0 0x7fe1e8076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.097+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== osd.4 v2:172.21.15.171:6805/37616255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1e80775c0 con 0x7fe1e8074af0 2024-04-16T12:58:12.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.110+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 --> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe1fc0691a0 con 0x7fe1e8074af0 2024-04-16T12:58:12.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.110+0000 7fe1e37fe640 1 -- 172.21.15.106:0/2728376978 <== osd.4 v2:172.21.15.171:6805/37616255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe1fc0691a0 con 0x7fe1e8074af0 2024-04-16T12:58:12.114 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:12.114 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:12.114 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:12.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.110+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7fe1e8074af0 msgr2=0x7fe1e8076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.171:6805/37616255,v1:172.21.15.171:6807/37616255] conn(0x7fe1e8074af0 0x7fe1e8076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1e806c8f0 msgr2=0x7fe1e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fe1e806c8f0 0x7fe1e806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b10d0 tx=0x7fe1f0009040 comp rx=0 tx=0).stop 2024-04-16T12:58:12.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc06f5f0 msgr2=0x7fe1fc0b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 --2- 172.21.15.106:0/2728376978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1fc06f5f0 0x7fe1fc0b36c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c4a0 tx=0x7fe1ec00c960 comp rx=0 tx=0).stop 2024-04-16T12:58:12.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe1fb7fe640 1 -- 172.21.15.106:0/2728376978 reap_dead start 2024-04-16T12:58:12.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 shutdown_connections 2024-04-16T12:58:12.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 >> 172.21.15.106:0/2728376978 conn(0x7fe1fc0b6f40 msgr2=0x7fe1fc144110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 shutdown_connections 2024-04-16T12:58:12.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.111+0000 7fe20170d640 1 -- 172.21.15.106:0/2728376978 wait complete. 2024-04-16T12:58:12.124 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-16T12:58:12.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.226+0000 7febf7b74640 1 Processor -- start 2024-04-16T12:58:12.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.226+0000 7febf7b74640 1 -- start start 2024-04-16T12:58:12.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.226+0000 7febf7b74640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7febf00b82b0 0x7febf0153400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.226+0000 7febf7b74640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf00b9630 con 0x7febf00b9d30 2024-04-16T12:58:12.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.226+0000 7febf7b74640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf00b7400 con 0x7febf006f880 2024-04-16T12:58:12.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.226+0000 7febf7b74640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7febf006ec50 con 0x7febf00b82b0 2024-04-16T12:58:12.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf5910640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7febf00b9d30 0x7febf006f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43068/0 (socket says 172.21.15.106:43068) 2024-04-16T12:58:12.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf5910640 1 -- 172.21.15.106:0/3823948179 learned_addr learned my addr 172.21.15.106:0/3823948179 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:12.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf6111640 1 --2- 172.21.15.106:0/3823948179 >> v2:172.21.15.171:3300/0 conn(0x7febf00b82b0 0x7febf0153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396320125 0 0) 0x7febf00b9630 con 0x7febf00b9d30 2024-04-16T12:58:12.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febdc003520 con 0x7febf00b9d30 2024-04-16T12:58:12.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3689578720 0 0) 0x7febdc003520 con 0x7febf00b9d30 2024-04-16T12:58:12.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 >> v2:172.21.15.171:3300/0 conn(0x7febf00b82b0 msgr2=0x7febf0153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:12.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 --2- 172.21.15.106:0/3823948179 >> v2:172.21.15.171:3300/0 conn(0x7febf00b82b0 0x7febf0153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 >> v1:172.21.15.171:6789/0 conn(0x7febf006f880 legacy=0x7febf014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf00b9350 con 0x7febf00b9d30 2024-04-16T12:58:12.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7febec001670 con 0x7febf00b9d30 2024-04-16T12:58:12.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 >> v1:172.21.15.106:6789/0 conn(0x7febf00b9d30 legacy=0x7febf006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febdc0039b0 0x7febdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febdc004800 0x7febdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7febf006ec50 con 0x7febdc0051c0 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7febdc00c160 con 0x7febdc0039b0 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7febdc00c360 con 0x7febdc004800 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf6111640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf5910640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febdc0039b0 0x7febdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.227+0000 7febf510f640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febdc004800 0x7febdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf6111640 1 -- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febdc004800 msgr2=0x7febdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:12.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf6111640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febdc004800 0x7febdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf6111640 1 -- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febdc0039b0 msgr2=0x7febdc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:12.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf6111640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febdc0039b0 0x7febdc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf6111640 1 -- 172.21.15.106:0/3823948179 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc003520 con 0x7febdc0051c0 2024-04-16T12:58:12.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf6111640 1 -- 172.21.15.106:0/3823948179 reap_dead start 2024-04-16T12:58:12.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf6111640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febdc00b9c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7febe8009fc0 tx=0x7febdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27810151eef80386 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8009c10 con 0x7febdc0051c0 2024-04-16T12:58:12.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe802cca0 con 0x7febdc0051c0 2024-04-16T12:58:12.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.228+0000 7febf490e640 1 -- 172.21.15.106:0/3823948179 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8003bd0 con 0x7febdc0051c0 2024-04-16T12:58:12.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.229+0000 7febf7b74640 1 -- 172.21.15.106:0/3823948179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 msgr2=0x7febdc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.229+0000 7febf7b74640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febdc00b9c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7febe8009fc0 tx=0x7febdc005830 comp rx=0 tx=0).stop 2024-04-16T12:58:12.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.229+0000 7febf7b74640 1 -- 172.21.15.106:0/3823948179 shutdown_connections 2024-04-16T12:58:12.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.229+0000 7febf7b74640 1 --2- 172.21.15.106:0/3823948179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febdc00b9c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.229+0000 7febf7b74640 1 -- 172.21.15.106:0/3823948179 >> 172.21.15.106:0/3823948179 conn(0x7febf00ba4b0 msgr2=0x7febf00ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.229+0000 7febf7b74640 1 -- 172.21.15.106:0/3823948179 shutdown_connections 2024-04-16T12:58:12.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.229+0000 7febf7b74640 1 -- 172.21.15.106:0/3823948179 wait complete. 2024-04-16T12:58:12.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.230+0000 7febf7b74640 1 Processor -- start 2024-04-16T12:58:12.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.230+0000 7febf7b74640 1 -- start start 2024-04-16T12:58:12.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febf01cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febf01ce290 0x7febf01e0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febf01e1060 0x7febf01dd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7febf006f170 con 0x7febdc0051c0 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7febf00ba110 con 0x7febf01e1060 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7febf006f2f0 con 0x7febf01ce290 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febf01cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febf01cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39048/0 (socket says 172.21.15.106:39048) 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 -- 172.21.15.106:0/3304434134 learned_addr learned my addr 172.21.15.106:0/3304434134 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf6111640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febf01e1060 0x7febf01dd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf510f640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febf01ce290 0x7febf01e0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 -- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febf01ce290 msgr2=0x7febf01e0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febf01ce290 0x7febf01e0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 -- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febf01e1060 msgr2=0x7febf01dd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febf01e1060 0x7febf01dd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 -- 172.21.15.106:0/3304434134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf00b0380 con 0x7febdc0051c0 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf5910640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febf01cdd50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7febec004f70 tx=0x7febec0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febe67fc640 1 -- 172.21.15.106:0/3304434134 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec007740 con 0x7febdc0051c0 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febe67fc640 1 -- 172.21.15.106:0/3304434134 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febec018070 con 0x7febdc0051c0 2024-04-16T12:58:12.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf009f200 con 0x7febdc0051c0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febe67fc640 1 -- 172.21.15.106:0/3304434134 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec00fb80 con 0x7febdc0051c0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.231+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf00b00a0 con 0x7febdc0051c0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.232+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf0068a90 con 0x7febdc0051c0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.233+0000 7febe67fc640 1 -- 172.21.15.106:0/3304434134 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7febec00fd20 con 0x7febdc0051c0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.233+0000 7febe67fc640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7febd406ca90 0x7febd406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.233+0000 7febe67fc640 1 -- 172.21.15.106:0/3304434134 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7febec08bab0 con 0x7febdc0051c0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.233+0000 7febf510f640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7febd406ca90 0x7febd406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.234+0000 7febf510f640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7febd406ca90 0x7febd406ef50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7febe0000c00 tx=0x7febe0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.238+0000 7febe67fc640 1 -- 172.21.15.106:0/3304434134 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febec059f70 con 0x7febdc0051c0 2024-04-16T12:58:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.415+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7febf00b2a60 con 0x7febd406ca90 2024-04-16T12:58:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.415+0000 7febe67fc640 1 -- 172.21.15.106:0/3304434134 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7febf00b2a60 con 0x7febd406ca90 2024-04-16T12:58:12.418 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 4 to deep-scrub 2024-04-16T12:58:12.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7febd406ca90 msgr2=0x7febd406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7febd406ca90 0x7febd406ef50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7febe0000c00 tx=0x7febe0009040 comp rx=0 tx=0).stop 2024-04-16T12:58:12.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 msgr2=0x7febf01cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febf01cdd50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7febec004f70 tx=0x7febec0074f0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 shutdown_connections 2024-04-16T12:58:12.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7febd406ca90 0x7febd406ef50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febf01e1060 0x7febf01dd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febf01ce290 0x7febf01e0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 --2- 172.21.15.106:0/3304434134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febdc0051c0 0x7febf01cdd50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 >> 172.21.15.106:0/3304434134 conn(0x7febf00ba4b0 msgr2=0x7febf009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 shutdown_connections 2024-04-16T12:58:12.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.418+0000 7febf7b74640 1 -- 172.21.15.106:0/3304434134 wait complete. 2024-04-16T12:58:12.431 INFO:tasks.ceph:Scrubbing osd.5 2024-04-16T12:58:12.431 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:12.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.535+0000 7f6930fa8640 1 Processor -- start 2024-04-16T12:58:12.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.535+0000 7f6930fa8640 1 -- start start 2024-04-16T12:58:12.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6930fa8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f692c09b140 0x7f692c144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6930fa8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f692c0b6b80 0x7f692c145020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6930fa8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692c0b5be0 con 0x7f692c06bc20 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6930fa8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f692c09bf40 con 0x7f692c0b6b80 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6930fa8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f692c09b8f0 con 0x7f692c09b140 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f692ad9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f692c0b6b80 0x7f692c145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f692a59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f692c06bc20 0x7f692c0b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43070/0 (socket says 172.21.15.106:43070) 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f692a59c640 1 -- 172.21.15.106:0/1196869378 learned_addr learned my addr 172.21.15.106:0/1196869378 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6923fff640 1 --2- 172.21.15.106:0/1196869378 >> v2:172.21.15.171:3300/0 conn(0x7f692c09b140 0x7f692c144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f692ad9d640 1 -- 172.21.15.106:0/1196869378 >> v2:172.21.15.171:3300/0 conn(0x7f692c09b140 msgr2=0x7f692c144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:12.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f692ad9d640 1 --2- 172.21.15.106:0/1196869378 >> v2:172.21.15.171:3300/0 conn(0x7f692c09b140 0x7f692c144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f692ad9d640 1 -- 172.21.15.106:0/1196869378 >> v1:172.21.15.106:6789/0 conn(0x7f692c06bc20 legacy=0x7f692c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6929d9b640 1 -- 172.21.15.106:0/1196869378 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147899492 0 0) 0x7f692c0b5be0 con 0x7f692c06bc20 2024-04-16T12:58:12.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f692ad9d640 1 -- 172.21.15.106:0/1196869378 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c09bbd0 con 0x7f692c0b6b80 2024-04-16T12:58:12.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.536+0000 7f6923fff640 1 --2- 172.21.15.106:0/1196869378 >> v2:172.21.15.171:3300/0 conn(0x7f692c09b140 0x7f692c144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:12.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.537+0000 7f692ad9d640 1 --2- 172.21.15.106:0/1196869378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0b6b80 0x7f692c145020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6924009d90 tx=0x7f692402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4dd1b040ccafad server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.537+0000 7f6929d9b640 1 -- 172.21.15.106:0/1196869378 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924039070 con 0x7f692c0b6b80 2024-04-16T12:58:12.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.537+0000 7f6929d9b640 1 -- 172.21.15.106:0/1196869378 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692402cbd0 con 0x7f692c0b6b80 2024-04-16T12:58:12.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.537+0000 7f6929d9b640 1 -- 172.21.15.106:0/1196869378 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924034440 con 0x7f692c0b6b80 2024-04-16T12:58:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 -- 172.21.15.106:0/1196869378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0b6b80 msgr2=0x7f692c145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 --2- 172.21.15.106:0/1196869378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0b6b80 0x7f692c145020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6924009d90 tx=0x7f692402be20 comp rx=0 tx=0).stop 2024-04-16T12:58:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 -- 172.21.15.106:0/1196869378 shutdown_connections 2024-04-16T12:58:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 --2- 172.21.15.106:0/1196869378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0b6b80 0x7f692c145020 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 --2- 172.21.15.106:0/1196869378 >> v2:172.21.15.171:3300/0 conn(0x7f692c09b140 0x7f692c144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 -- 172.21.15.106:0/1196869378 >> 172.21.15.106:0/1196869378 conn(0x7f692c09c370 msgr2=0x7f692c09c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 -- 172.21.15.106:0/1196869378 shutdown_connections 2024-04-16T12:58:12.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.538+0000 7f6930fa8640 1 -- 172.21.15.106:0/1196869378 wait complete. 2024-04-16T12:58:12.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 Processor -- start 2024-04-16T12:58:12.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 -- start start 2024-04-16T12:58:12.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c06bc20 0x7f692c09f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f692c0b6b80 0x7f692c0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0afff0 0x7f692c1e0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f692c06c180 con 0x7f692c0afff0 2024-04-16T12:58:12.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f692c06c000 con 0x7f692c06bc20 2024-04-16T12:58:12.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.539+0000 7f6930fa8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f692c06c300 con 0x7f692c0b6b80 2024-04-16T12:58:12.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0afff0 0x7f692c1e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0afff0 0x7f692c1e0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39072/0 (socket says 172.21.15.106:39072) 2024-04-16T12:58:12.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 -- 172.21.15.106:0/3311109467 learned_addr learned my addr 172.21.15.106:0/3311109467 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:12.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692a59c640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c06bc20 0x7f692c09f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f6923fff640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f692c0b6b80 0x7f692c0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 -- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f692c0b6b80 msgr2=0x7f692c0b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f692c0b6b80 0x7f692c0b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 -- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c06bc20 msgr2=0x7f692c09f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c06bc20 0x7f692c09f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 -- 172.21.15.106:0/3311109467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c0b10a0 con 0x7f692c0afff0 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f6923fff640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f692c0b6b80 0x7f692c0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f692ad9d640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0afff0 0x7f692c1e0790 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6924009d90 tx=0x7f6924004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924039050 con 0x7f692c0afff0 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6924045070 con 0x7f692c0afff0 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692403e830 con 0x7f692c0afff0 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c0af5e0 con 0x7f692c0afff0 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.540+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c0b1600 con 0x7f692c0afff0 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.541+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f692c0691a0 con 0x7f692c0afff0 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.542+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f692403e9d0 con 0x7f692c0afff0 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.542+0000 7f6922ffd640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f690c06c8f0 0x7f690c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.542+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f69240af140 con 0x7f692c0afff0 2024-04-16T12:58:12.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.542+0000 7f692a59c640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f690c06c8f0 0x7f690c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.542+0000 7f6922ffd640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f690c074af0 0x7f690c076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.542+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 --> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f690c0775c0 con 0x7f690c074af0 2024-04-16T12:58:12.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.542+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69240af5d0 con 0x7f692c0afff0 2024-04-16T12:58:12.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.543+0000 7f692a59c640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f690c06c8f0 0x7f690c06edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f691c000f60 tx=0x7f691c007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.543+0000 7f6923fff640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f690c074af0 0x7f690c076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.543+0000 7f6923fff640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f690c074af0 0x7f690c076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.544+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== osd.5 v2:172.21.15.171:6800/1858725458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f690c0775c0 con 0x7f690c074af0 2024-04-16T12:58:12.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.557+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 --> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f692c0b5620 con 0x7f690c074af0 2024-04-16T12:58:12.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.557+0000 7f6922ffd640 1 -- 172.21.15.106:0/3311109467 <== osd.5 v2:172.21.15.171:6800/1858725458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f692c0b5620 con 0x7f690c074af0 2024-04-16T12:58:12.560 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:12.560 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:12.560 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f690c074af0 msgr2=0x7f690c076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.171:6800/1858725458,v1:172.21.15.171:6801/1858725458] conn(0x7f690c074af0 0x7f690c076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f690c06c8f0 msgr2=0x7f690c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f690c06c8f0 0x7f690c06edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f691c000f60 tx=0x7f691c007d50 comp rx=0 tx=0).stop 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0afff0 msgr2=0x7f692c1e0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 --2- 172.21.15.106:0/3311109467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f692c0afff0 0x7f692c1e0790 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6924009d90 tx=0x7f6924004a40 comp rx=0 tx=0).stop 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f692ad9d640 1 -- 172.21.15.106:0/3311109467 reap_dead start 2024-04-16T12:58:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 shutdown_connections 2024-04-16T12:58:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 >> 172.21.15.106:0/3311109467 conn(0x7f692c09c370 msgr2=0x7f692c1468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 shutdown_connections 2024-04-16T12:58:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.558+0000 7f6930fa8640 1 -- 172.21.15.106:0/3311109467 wait complete. 2024-04-16T12:58:12.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-16T12:58:12.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.671+0000 7f02ea31c640 1 Processor -- start 2024-04-16T12:58:12.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.671+0000 7f02ea31c640 1 -- start start 2024-04-16T12:58:12.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02ea31c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e406db00 0x7f02e40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02ea31c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e40b4d60 con 0x7f02e40b5520 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02ea31c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e406dee0 con 0x7f02e40b5e00 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02ea31c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02e40b5090 con 0x7f02e406db00 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02dbfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f02e40b5520 0x7f02e4144cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42584/0 (socket says 172.21.15.106:42584) 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02dbfff640 1 -- 172.21.15.106:0/771065685 learned_addr learned my addr 172.21.15.106:0/771065685 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e3fff640 1 --2- 172.21.15.106:0/771065685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e406db00 0x7f02e40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e37fe640 1 -- 172.21.15.106:0/771065685 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681852228 0 0) 0x7f02e40b4d60 con 0x7f02e40b5520 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e37fe640 1 -- 172.21.15.106:0/771065685 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d0003520 con 0x7f02e40b5520 2024-04-16T12:58:12.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e37fe640 1 -- 172.21.15.106:0/771065685 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500961006 0 0) 0x7f02e406dee0 con 0x7f02e40b5e00 2024-04-16T12:58:12.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e37fe640 1 -- 172.21.15.106:0/771065685 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e40b4d60 con 0x7f02e40b5e00 2024-04-16T12:58:12.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e3fff640 1 -- 172.21.15.106:0/771065685 >> v1:172.21.15.171:6789/0 conn(0x7f02e40b5e00 legacy=0x7f02e4143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e3fff640 1 -- 172.21.15.106:0/771065685 >> v1:172.21.15.106:6789/0 conn(0x7f02e40b5520 legacy=0x7f02e4144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.672+0000 7f02e3fff640 1 -- 172.21.15.106:0/771065685 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e40b4570 con 0x7f02e406db00 2024-04-16T12:58:12.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.673+0000 7f02e3fff640 1 --2- 172.21.15.106:0/771065685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e406db00 0x7f02e40b3ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f02d40097d0 tx=0x7f02d402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa0d19bddbfb7a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.673+0000 7f02e37fe640 1 -- 172.21.15.106:0/771065685 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4035020 con 0x7f02e406db00 2024-04-16T12:58:12.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02e37fe640 1 -- 172.21.15.106:0/771065685 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d4031800 con 0x7f02e406db00 2024-04-16T12:58:12.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02e37fe640 1 -- 172.21.15.106:0/771065685 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4031bb0 con 0x7f02e406db00 2024-04-16T12:58:12.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02ea31c640 1 -- 172.21.15.106:0/771065685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e406db00 msgr2=0x7f02e40b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02ea31c640 1 --2- 172.21.15.106:0/771065685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e406db00 0x7f02e40b3ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f02d40097d0 tx=0x7f02d402b8a0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02ea31c640 1 -- 172.21.15.106:0/771065685 shutdown_connections 2024-04-16T12:58:12.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02ea31c640 1 --2- 172.21.15.106:0/771065685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e406db00 0x7f02e40b3ea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02ea31c640 1 -- 172.21.15.106:0/771065685 >> 172.21.15.106:0/771065685 conn(0x7f02e409cc10 msgr2=0x7f02e406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02ea31c640 1 -- 172.21.15.106:0/771065685 shutdown_connections 2024-04-16T12:58:12.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.674+0000 7f02ea31c640 1 -- 172.21.15.106:0/771065685 wait complete. 2024-04-16T12:58:12.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.675+0000 7f02ea31c640 1 Processor -- start 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.675+0000 7f02ea31c640 1 -- start start 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02ea31c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02e406db00 0x7f02e409d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02ea31c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e40b5e00 0x7f02e41d1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02ea31c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e41dd370 0x7f02e4140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02ea31c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4144710 con 0x7f02e41dd370 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02ea31c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4144590 con 0x7f02e406db00 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02ea31c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02e4144890 con 0x7f02e40b5e00 2024-04-16T12:58:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e41dd370 0x7f02e4140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e41dd370 0x7f02e4140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59388/0 (socket says 172.21.15.106:59388) 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02dbfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e40b5e00 0x7f02e41d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 -- 172.21.15.106:0/3573774566 learned_addr learned my addr 172.21.15.106:0/3573774566 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02e406db00 0x7f02e409d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 -- 172.21.15.106:0/3573774566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e40b5e00 msgr2=0x7f02e41d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e40b5e00 0x7f02e41d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 -- 172.21.15.106:0/3573774566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02e406db00 msgr2=0x7f02e409d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02e406db00 0x7f02e409d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 -- 172.21.15.106:0/3573774566 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e40b2880 con 0x7f02e41dd370 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e88b9640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e41dd370 0x7f02e4140400 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c680 tx=0x7f02dc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e17fa640 1 -- 172.21.15.106:0/3573774566 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc003b70 con 0x7f02e41dd370 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e17fa640 1 -- 172.21.15.106:0/3573774566 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc003d10 con 0x7f02e41dd370 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e41cf990 con 0x7f02e41dd370 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.676+0000 7f02e17fa640 1 -- 172.21.15.106:0/3573774566 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc005310 con 0x7f02e41dd370 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.677+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e41d0f80 con 0x7f02e41dd370 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.677+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e4068a90 con 0x7f02e41dd370 2024-04-16T12:58:12.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.678+0000 7f02e17fa640 1 -- 172.21.15.106:0/3573774566 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02dc0054b0 con 0x7f02e41dd370 2024-04-16T12:58:12.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.678+0000 7f02e17fa640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f02c406c8f0 0x7f02c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.678+0000 7f02e17fa640 1 -- 172.21.15.106:0/3573774566 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f02dc08b7d0 con 0x7f02e41dd370 2024-04-16T12:58:12.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.678+0000 7f02e3fff640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f02c406c8f0 0x7f02c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.679+0000 7f02e3fff640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f02c406c8f0 0x7f02c406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f02d4036000 tx=0x7f02d4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.683+0000 7f02e17fa640 1 -- 172.21.15.106:0/3573774566 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02dc059640 con 0x7f02e41dd370 2024-04-16T12:58:12.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.862+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f02e4073470 con 0x7f02c406c8f0 2024-04-16T12:58:12.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.863+0000 7f02e17fa640 1 -- 172.21.15.106:0/3573774566 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f02e4073470 con 0x7f02c406c8f0 2024-04-16T12:58:12.866 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 5 to deep-scrub 2024-04-16T12:58:12.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f02c406c8f0 msgr2=0x7f02c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f02c406c8f0 0x7f02c406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f02d4036000 tx=0x7f02d4008030 comp rx=0 tx=0).stop 2024-04-16T12:58:12.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e41dd370 msgr2=0x7f02e4140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e41dd370 0x7f02e4140400 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c680 tx=0x7f02dc00cb40 comp rx=0 tx=0).stop 2024-04-16T12:58:12.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 shutdown_connections 2024-04-16T12:58:12.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f02c406c8f0 0x7f02c406edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e41dd370 0x7f02e4140400 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02e40b5e00 0x7f02e41d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 --2- 172.21.15.106:0/3573774566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02e406db00 0x7f02e409d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 >> 172.21.15.106:0/3573774566 conn(0x7f02e409cc10 msgr2=0x7f02e40b9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 shutdown_connections 2024-04-16T12:58:12.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.865+0000 7f02ea31c640 1 -- 172.21.15.106:0/3573774566 wait complete. 2024-04-16T12:58:12.878 INFO:tasks.ceph:Scrubbing osd.6 2024-04-16T12:58:12.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:12.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9b1396640 1 Processor -- start 2024-04-16T12:58:12.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9b1396640 1 -- start start 2024-04-16T12:58:12.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9b1396640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9ac0b6930 0x7fc9ac141c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9b1396640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9ac142160 0x7fc9ac0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9b1396640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9ac0b7930 con 0x7fc9ac14b620 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9b1396640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ac0b50e0 con 0x7fc9ac0b6930 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9b1396640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ac0b4d70 con 0x7fc9ac142160 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9a27fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9ac0b6930 0x7fc9ac141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.983+0000 7fc9a27fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9ac0b6930 0x7fc9ac141c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59392/0 (socket says 172.21.15.106:59392) 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.984+0000 7fc9a27fc640 1 -- 172.21.15.106:0/3283530186 learned_addr learned my addr 172.21.15.106:0/3283530186 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.984+0000 7fc9ab7fe640 1 --2- 172.21.15.106:0/3283530186 >> v2:172.21.15.171:3300/0 conn(0x7fc9ac142160 0x7fc9ac0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.984+0000 7fc9a27fc640 1 -- 172.21.15.106:0/3283530186 >> v2:172.21.15.171:3300/0 conn(0x7fc9ac142160 msgr2=0x7fc9ac0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.984+0000 7fc9a27fc640 1 --2- 172.21.15.106:0/3283530186 >> v2:172.21.15.171:3300/0 conn(0x7fc9ac142160 0x7fc9ac0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.984+0000 7fc9a27fc640 1 -- 172.21.15.106:0/3283530186 >> v1:172.21.15.171:6789/0 conn(0x7fc9ac14b620 legacy=0x7fc9ac14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:12.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.984+0000 7fc9a27fc640 1 -- 172.21.15.106:0/3283530186 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac14c110 con 0x7fc9ac0b6930 2024-04-16T12:58:12.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9a27fc640 1 --2- 172.21.15.106:0/3283530186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac0b6930 0x7fc9ac141c20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0b9990 tx=0x7fc99402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1faadab6154efe64 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9aa7fc640 1 -- 172.21.15.106:0/3283530186 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994035020 con 0x7fc9ac0b6930 2024-04-16T12:58:12.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9aa7fc640 1 -- 172.21.15.106:0/3283530186 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc994031870 con 0x7fc9ac0b6930 2024-04-16T12:58:12.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9aa7fc640 1 -- 172.21.15.106:0/3283530186 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994031c40 con 0x7fc9ac0b6930 2024-04-16T12:58:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 -- 172.21.15.106:0/3283530186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac0b6930 msgr2=0x7fc9ac141c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 --2- 172.21.15.106:0/3283530186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac0b6930 0x7fc9ac141c20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0b9990 tx=0x7fc99402b910 comp rx=0 tx=0).stop 2024-04-16T12:58:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 -- 172.21.15.106:0/3283530186 shutdown_connections 2024-04-16T12:58:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 --2- 172.21.15.106:0/3283530186 >> v2:172.21.15.171:3300/0 conn(0x7fc9ac142160 0x7fc9ac0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 --2- 172.21.15.106:0/3283530186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac0b6930 0x7fc9ac141c20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 -- 172.21.15.106:0/3283530186 >> 172.21.15.106:0/3283530186 conn(0x7fc9ac067760 msgr2=0x7fc9ac067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:12.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 -- 172.21.15.106:0/3283530186 shutdown_connections 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.985+0000 7fc9b1396640 1 -- 172.21.15.106:0/3283530186 wait complete. 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.986+0000 7fc9b1396640 1 Processor -- start 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.986+0000 7fc9b1396640 1 -- start start 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9b1396640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9ac0b6930 0x7fc9ac145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9b1396640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ac142160 0x7fc9ac13c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9b1396640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac14b620 0x7fc9ac1e1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9b1396640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac0b5e80 con 0x7fc9ac14b620 2024-04-16T12:58:12.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9b1396640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac0b5d00 con 0x7fc9ac142160 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9b1396640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ac152740 con 0x7fc9ac0b6930 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac14b620 0x7fc9ac1e1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac14b620 0x7fc9ac1e1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59400/0 (socket says 172.21.15.106:59400) 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 -- 172.21.15.106:0/2329600589 learned_addr learned my addr 172.21.15.106:0/2329600589 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9a27fc640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ac142160 0x7fc9ac13c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9aaffd640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9ac0b6930 0x7fc9ac145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 -- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9ac0b6930 msgr2=0x7fc9ac145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9ac0b6930 0x7fc9ac145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 -- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ac142160 msgr2=0x7fc9ac13c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ac142160 0x7fc9ac13c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9ab7fe640 1 -- 172.21.15.106:0/2329600589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac1e0e20 con 0x7fc9ac14b620 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.987+0000 7fc9a27fc640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ac142160 0x7fc9ac13c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.988+0000 7fc9ab7fe640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac14b620 0x7fc9ac1e1900 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4007e40 tx=0x7fc9a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.988+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4014620 con 0x7fc9ac14b620 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.988+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a4019070 con 0x7fc9ac14b620 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.988+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac1e1100 con 0x7fc9ac14b620 2024-04-16T12:58:12.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.988+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4014a20 con 0x7fc9ac14b620 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.988+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac143970 con 0x7fc9ac14b620 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.988+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9ac14bf30 con 0x7fc9ac14b620 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.989+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9a4014bc0 con 0x7fc9ac14b620 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.989+0000 7fc9a3fff640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc98c06c8f0 0x7fc98c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fc9a408c410 con 0x7fc9ac14b620 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9aaffd640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc98c06c8f0 0x7fc98c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9a3fff640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7fc98c074af0 0x7fc98c076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:12.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 --> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc98c0775c0 con 0x7fc98c074af0 2024-04-16T12:58:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9a4093050 con 0x7fc9ac14b620 2024-04-16T12:58:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9a27fc640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7fc98c074af0 0x7fc98c076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9aaffd640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc98c06c8f0 0x7fc98c06edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc99c007fd0 tx=0x7fc99c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.990+0000 7fc9a27fc640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7fc98c074af0 0x7fc98c076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:12.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:12.991+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== osd.6 v2:172.21.15.171:6816/2241406826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc98c0775c0 con 0x7fc98c074af0 2024-04-16T12:58:13.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.004+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 --> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9ac068a90 con 0x7fc98c074af0 2024-04-16T12:58:13.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9a3fff640 1 -- 172.21.15.106:0/2329600589 <== osd.6 v2:172.21.15.171:6816/2241406826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9ac068a90 con 0x7fc98c074af0 2024-04-16T12:58:13.007 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:13.007 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:13.008 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:13.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7fc98c074af0 msgr2=0x7fc98c076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.171:6816/2241406826,v1:172.21.15.171:6819/2241406826] conn(0x7fc98c074af0 0x7fc98c076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc98c06c8f0 msgr2=0x7fc98c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fc98c06c8f0 0x7fc98c06edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc99c007fd0 tx=0x7fc99c009040 comp rx=0 tx=0).stop 2024-04-16T12:58:13.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac14b620 msgr2=0x7fc9ac1e1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 --2- 172.21.15.106:0/2329600589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9ac14b620 0x7fc9ac1e1900 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4007e40 tx=0x7fc9a400e4b0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9ab7fe640 1 -- 172.21.15.106:0/2329600589 reap_dead start 2024-04-16T12:58:13.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 shutdown_connections 2024-04-16T12:58:13.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 >> 172.21.15.106:0/2329600589 conn(0x7fc9ac067760 msgr2=0x7fc9ac0ba680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 shutdown_connections 2024-04-16T12:58:13.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.005+0000 7fc9b1396640 1 -- 172.21.15.106:0/2329600589 wait complete. 2024-04-16T12:58:13.018 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-16T12:58:13.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.119+0000 7f7a6d15f640 1 Processor -- start 2024-04-16T12:58:13.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.119+0000 7f7a6d15f640 1 -- start start 2024-04-16T12:58:13.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a6d15f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7a680b63a0 0x7f7a680b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a6d15f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a68148b70 con 0x7f7a681481c0 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a6d15f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a680b4bd0 con 0x7f7a68148670 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a6d15f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7a680b4eb0 con 0x7f7a680b63a0 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a6659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7a681481c0 0x7f7a681418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42588/0 (socket says 172.21.15.106:42588) 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a6659c640 1 -- 172.21.15.106:0/1017290901 learned_addr learned my addr 172.21.15.106:0/1017290901 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385347685 0 0) 0x7f7a68148b70 con 0x7f7a681481c0 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a66d9d640 1 --2- 172.21.15.106:0/1017290901 >> v2:172.21.15.171:3300/0 conn(0x7f7a680b63a0 0x7f7a680b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a50003520 con 0x7f7a681481c0 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867048041 0 0) 0x7f7a50003520 con 0x7f7a681481c0 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 >> v2:172.21.15.171:3300/0 conn(0x7f7a680b63a0 msgr2=0x7f7a680b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 --2- 172.21.15.106:0/1017290901 >> v2:172.21.15.171:3300/0 conn(0x7f7a680b63a0 0x7f7a680b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 >> v1:172.21.15.171:6789/0 conn(0x7f7a68148670 legacy=0x7f7a680b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a68141fb0 con 0x7f7a681481c0 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1536906073 0 0) 0x7f7a5c001670 con 0x7f7a681481c0 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 >> v1:172.21.15.106:6789/0 conn(0x7f7a681481c0 legacy=0x7f7a681418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a500039b0 0x7f7a50003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.120+0000 7f7a65d9b640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a65d9b640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a500051c0 0x7f7a5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680b4eb0 con 0x7f7a50004800 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5000c0f0 con 0x7f7a500051c0 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5000c2f0 con 0x7f7a500039b0 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6659c640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a66d9d640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a500039b0 0x7f7a50003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6759e640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a500051c0 0x7f7a5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6659c640 1 -- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a500039b0 msgr2=0x7f7a50003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6659c640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a500039b0 0x7f7a50003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6659c640 1 -- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a500051c0 msgr2=0x7f7a5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6659c640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a500051c0 0x7f7a5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6759e640 1 -- 172.21.15.106:0/1017290901 reap_dead start 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.121+0000 7f7a6659c640 1 -- 172.21.15.106:0/1017290901 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50003520 con 0x7f7a50004800 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6659c640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c290 tx=0x7f7a50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf08b0ebcb0f4d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c007d50 con 0x7f7a50004800 2024-04-16T12:58:13.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c030070 con 0x7f7a50004800 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a65d9b640 1 -- 172.21.15.106:0/1017290901 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c02cda0 con 0x7f7a50004800 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6d15f640 1 -- 172.21.15.106:0/1017290901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 msgr2=0x7f7a50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c290 tx=0x7f7a50005830 comp rx=0 tx=0).stop 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6d15f640 1 -- 172.21.15.106:0/1017290901 shutdown_connections 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/1017290901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6d15f640 1 -- 172.21.15.106:0/1017290901 >> 172.21.15.106:0/1017290901 conn(0x7f7a68068080 msgr2=0x7f7a680bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6d15f640 1 -- 172.21.15.106:0/1017290901 shutdown_connections 2024-04-16T12:58:13.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.122+0000 7f7a6d15f640 1 -- 172.21.15.106:0/1017290901 wait complete. 2024-04-16T12:58:13.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 Processor -- start 2024-04-16T12:58:13.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 -- start start 2024-04-16T12:58:13.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a6814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a681dd500 0x7f7a681dd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6813c880 0x7f7a6813cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680b6b10 con 0x7f7a50004800 2024-04-16T12:58:13.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680b6990 con 0x7f7a681dd500 2024-04-16T12:58:13.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a6d15f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a681418a0 con 0x7f7a6813c880 2024-04-16T12:58:13.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a66d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a6814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a66d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a6814b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59418/0 (socket says 172.21.15.106:59418) 2024-04-16T12:58:13.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.124+0000 7f7a66d9d640 1 -- 172.21.15.106:0/559581265 learned_addr learned my addr 172.21.15.106:0/559581265 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:13.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a6759e640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6813c880 0x7f7a6813cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a6659c640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a681dd500 0x7f7a681dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a66d9d640 1 -- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6813c880 msgr2=0x7f7a6813cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a66d9d640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6813c880 0x7f7a6813cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a66d9d640 1 -- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a681dd500 msgr2=0x7f7a681dd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a66d9d640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a681dd500 0x7f7a681dd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a66d9d640 1 -- 172.21.15.106:0/559581265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a681d2210 con 0x7f7a50004800 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a66d9d640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a6814b4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7a58011e60 tx=0x7f7a5800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a4f7fe640 1 -- 172.21.15.106:0/559581265 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58015630 con 0x7f7a50004800 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a4f7fe640 1 -- 172.21.15.106:0/559581265 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a580157d0 con 0x7f7a50004800 2024-04-16T12:58:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6813d220 con 0x7f7a50004800 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a4f7fe640 1 -- 172.21.15.106:0/559581265 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58015ba0 con 0x7f7a50004800 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.125+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6814bf80 con 0x7f7a50004800 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.126+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a68068a90 con 0x7f7a50004800 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.127+0000 7f7a4f7fe640 1 -- 172.21.15.106:0/559581265 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a5801d400 con 0x7f7a50004800 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.127+0000 7f7a4f7fe640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a5406c8f0 0x7f7a5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.127+0000 7f7a4f7fe640 1 -- 172.21.15.106:0/559581265 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f7a5808cce0 con 0x7f7a50004800 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.127+0000 7f7a6659c640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a5406c8f0 0x7f7a5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.128+0000 7f7a6659c640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a5406c8f0 0x7f7a5406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c034000 tx=0x7f7a5c039040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.131+0000 7f7a4f7fe640 1 -- 172.21.15.106:0/559581265 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a681d2210 con 0x7f7a50004800 2024-04-16T12:58:13.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.308+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f7a68147970 con 0x7f7a5406c8f0 2024-04-16T12:58:13.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.309+0000 7f7a4f7fe640 1 -- 172.21.15.106:0/559581265 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7a68147970 con 0x7f7a5406c8f0 2024-04-16T12:58:13.311 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 6 to deep-scrub 2024-04-16T12:58:13.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a5406c8f0 msgr2=0x7f7a5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a5406c8f0 0x7f7a5406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c034000 tx=0x7f7a5c039040 comp rx=0 tx=0).stop 2024-04-16T12:58:13.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 msgr2=0x7f7a6814b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a6814b4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7a58011e60 tx=0x7f7a5800f580 comp rx=0 tx=0).stop 2024-04-16T12:58:13.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 shutdown_connections 2024-04-16T12:58:13.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f7a5406c8f0 0x7f7a5406edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6813c880 0x7f7a6813cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a681dd500 0x7f7a681dd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 --2- 172.21.15.106:0/559581265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a50004800 0x7f7a6814b4a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.310+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 >> 172.21.15.106:0/559581265 conn(0x7f7a68068080 msgr2=0x7f7a68145c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.311+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 shutdown_connections 2024-04-16T12:58:13.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.311+0000 7f7a6d15f640 1 -- 172.21.15.106:0/559581265 wait complete. 2024-04-16T12:58:13.324 INFO:tasks.ceph:Scrubbing osd.7 2024-04-16T12:58:13.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:58:13.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.431+0000 7f296b493640 1 Processor -- start 2024-04-16T12:58:13.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.431+0000 7f296b493640 1 -- start start 2024-04-16T12:58:13.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296b493640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f29640b44f0 0x7f29640b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296b493640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f296413f890 0x7f296413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296b493640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29640b5980 con 0x7f2964146130 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296b493640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f29640b5730 con 0x7f29640b44f0 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296b493640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2964140230 con 0x7f296413f890 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296922f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f29640b44f0 0x7f29640b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f2969a30640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2964146130 0x7f29641490f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42590/0 (socket says 172.21.15.106:42590) 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f2969a30640 1 -- 172.21.15.106:0/2533334576 learned_addr learned my addr 172.21.15.106:0/2533334576 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f2968a2e640 1 --2- 172.21.15.106:0/2533334576 >> v2:172.21.15.171:3300/0 conn(0x7f296413f890 0x7f296413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296922f640 1 -- 172.21.15.106:0/2533334576 >> v2:172.21.15.171:3300/0 conn(0x7f296413f890 msgr2=0x7f296413fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296922f640 1 --2- 172.21.15.106:0/2533334576 >> v2:172.21.15.171:3300/0 conn(0x7f296413f890 0x7f296413fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296922f640 1 -- 172.21.15.106:0/2533334576 >> v1:172.21.15.106:6789/0 conn(0x7f2964146130 legacy=0x7f29641490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f296922f640 1 -- 172.21.15.106:0/2533334576 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2964145c10 con 0x7f29640b44f0 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.432+0000 7f295bfff640 1 -- 172.21.15.106:0/2533334576 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558751266 0 0) 0x7f29640b5980 con 0x7f2964146130 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f296922f640 1 --2- 172.21.15.106:0/2533334576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29640b44f0 0x7f29640b48d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f29640b6240 tx=0x7f295402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83885400c866dc1b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f295bfff640 1 -- 172.21.15.106:0/2533334576 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29540315a0 con 0x7f29640b44f0 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f295bfff640 1 -- 172.21.15.106:0/2533334576 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2954037070 con 0x7f29640b44f0 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f295bfff640 1 -- 172.21.15.106:0/2533334576 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954031960 con 0x7f29640b44f0 2024-04-16T12:58:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f296b493640 1 -- 172.21.15.106:0/2533334576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29640b44f0 msgr2=0x7f29640b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f296b493640 1 --2- 172.21.15.106:0/2533334576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29640b44f0 0x7f29640b48d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f29640b6240 tx=0x7f295402b840 comp rx=0 tx=0).stop 2024-04-16T12:58:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f296b493640 1 -- 172.21.15.106:0/2533334576 shutdown_connections 2024-04-16T12:58:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f296b493640 1 --2- 172.21.15.106:0/2533334576 >> v2:172.21.15.171:3300/0 conn(0x7f296413f890 0x7f296413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f296b493640 1 --2- 172.21.15.106:0/2533334576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29640b44f0 0x7f29640b48d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.433+0000 7f296b493640 1 -- 172.21.15.106:0/2533334576 >> 172.21.15.106:0/2533334576 conn(0x7f29640bb4e0 msgr2=0x7f29640bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.434+0000 7f296b493640 1 -- 172.21.15.106:0/2533334576 shutdown_connections 2024-04-16T12:58:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.434+0000 7f296b493640 1 -- 172.21.15.106:0/2533334576 wait complete. 2024-04-16T12:58:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.434+0000 7f296b493640 1 Processor -- start 2024-04-16T12:58:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296b493640 1 -- start start 2024-04-16T12:58:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296b493640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29640b44f0 0x7f2964149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296b493640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f296413f890 0x7f296413b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296b493640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2964146130 0x7f296413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296b493640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f29640b52d0 con 0x7f2964146130 2024-04-16T12:58:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296b493640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f29640b5150 con 0x7f29640b44f0 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296b493640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f29641465c0 con 0x7f296413f890 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2964146130 0x7f296413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2964146130 0x7f296413bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59446/0 (socket says 172.21.15.106:59446) 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 -- 172.21.15.106:0/460934500 learned_addr learned my addr 172.21.15.106:0/460934500 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296922f640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29640b44f0 0x7f2964149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2968a2e640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f296413f890 0x7f296413b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 -- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f296413f890 msgr2=0x7f296413b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f296413f890 0x7f296413b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 -- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29640b44f0 msgr2=0x7f2964149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29640b44f0 0x7f2964149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2969a30640 1 -- 172.21.15.106:0/460934500 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29641491e0 con 0x7f2964146130 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f296922f640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29640b44f0 0x7f2964149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.435+0000 7f2968a2e640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f296413f890 0x7f296413b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.436+0000 7f2969a30640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2964146130 0x7f296413bf00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c700 tx=0x7f295c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.436+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c018070 con 0x7f2964146130 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.436+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295c00ce10 con 0x7f2964146130 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.436+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c00a860 con 0x7f2964146130 2024-04-16T12:58:13.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.436+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2964147170 con 0x7f2964146130 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.436+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2964148f00 con 0x7f2964146130 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.437+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2964068a90 con 0x7f2964146130 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.437+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f295c01b070 con 0x7f2964146130 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f2959ffb640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f294806c8f0 0x7f294806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f295c08b0c0 con 0x7f2964146130 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f296922f640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f294806c8f0 0x7f294806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f2959ffb640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7f2948074af0 0x7f2948076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 --> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29480775c0 con 0x7f2948074af0 2024-04-16T12:58:13.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f295c092050 con 0x7f2964146130 2024-04-16T12:58:13.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f2968a2e640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7f2948074af0 0x7f2948076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.438+0000 7f296922f640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f294806c8f0 0x7f294806edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2954036000 tx=0x7f2954008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.439+0000 7f2968a2e640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7f2948074af0 0x7f2948076f10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.440+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== osd.7 v2:172.21.15.171:6817/676267245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29480775c0 con 0x7f2948074af0 2024-04-16T12:58:13.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 --> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29640b7cb0 con 0x7f2948074af0 2024-04-16T12:58:13.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f2959ffb640 1 -- 172.21.15.106:0/460934500 <== osd.7 v2:172.21.15.171:6817/676267245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29640b7cb0 con 0x7f2948074af0 2024-04-16T12:58:13.456 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-16T12:58:13.456 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:58:13.456 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-16T12:58:13.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7f2948074af0 msgr2=0x7f2948076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.171:6817/676267245,v1:172.21.15.171:6818/676267245] conn(0x7f2948074af0 0x7f2948076f10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f294806c8f0 msgr2=0x7f294806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f294806c8f0 0x7f294806edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2954036000 tx=0x7f2954008030 comp rx=0 tx=0).stop 2024-04-16T12:58:13.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2964146130 msgr2=0x7f296413bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 --2- 172.21.15.106:0/460934500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2964146130 0x7f296413bf00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c700 tx=0x7f295c00cbc0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f2969a30640 1 -- 172.21.15.106:0/460934500 reap_dead start 2024-04-16T12:58:13.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 shutdown_connections 2024-04-16T12:58:13.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 >> 172.21.15.106:0/460934500 conn(0x7f29640bb4e0 msgr2=0x7f29640728c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 shutdown_connections 2024-04-16T12:58:13.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.454+0000 7f296b493640 1 -- 172.21.15.106:0/460934500 wait complete. 2024-04-16T12:58:13.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-16T12:58:13.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.567+0000 7fbb75fa8640 1 Processor -- start 2024-04-16T12:58:13.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.567+0000 7fbb75fa8640 1 -- start start 2024-04-16T12:58:13.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb75fa8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbb700679d0 0x7fbb700b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb75fa8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbb700b0ac0 0x7fbb700afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb75fa8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70067db0 con 0x7fbb7009fb60 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb75fa8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fbb700b45f0 con 0x7fbb700679d0 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb75fa8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbb700b01c0 con 0x7fbb700b0ac0 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb6f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbb700679d0 0x7fbb700b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb6f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbb700679d0 0x7fbb700b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59452/0 (socket says 172.21.15.106:59452) 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb6f7fe640 1 -- 172.21.15.106:0/277653102 learned_addr learned my addr 172.21.15.106:0/277653102 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb6f7fe640 1 -- 172.21.15.106:0/277653102 >> v2:172.21.15.171:3300/0 conn(0x7fbb700b0ac0 msgr2=0x7fbb700afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb6f7fe640 1 --2- 172.21.15.106:0/277653102 >> v2:172.21.15.171:3300/0 conn(0x7fbb700b0ac0 0x7fbb700afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb6f7fe640 1 -- 172.21.15.106:0/277653102 >> v1:172.21.15.171:6789/0 conn(0x7fbb7009fb60 legacy=0x7fbb70144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.568+0000 7fbb6f7fe640 1 -- 172.21.15.106:0/277653102 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb700b5b10 con 0x7fbb700679d0 2024-04-16T12:58:13.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.569+0000 7fbb6f7fe640 1 --2- 172.21.15.106:0/277653102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb700679d0 0x7fbb700b4a80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbb7006c9f0 tx=0x7fbb6002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bdce3bab68c3e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.569+0000 7fbb6e7fc640 1 -- 172.21.15.106:0/277653102 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6002ca80 con 0x7fbb700679d0 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.569+0000 7fbb6e7fc640 1 -- 172.21.15.106:0/277653102 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6002cc20 con 0x7fbb700679d0 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.569+0000 7fbb6e7fc640 1 -- 172.21.15.106:0/277653102 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb600343f0 con 0x7fbb700679d0 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 -- 172.21.15.106:0/277653102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb700679d0 msgr2=0x7fbb700b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/277653102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb700679d0 0x7fbb700b4a80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbb7006c9f0 tx=0x7fbb6002bee0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 -- 172.21.15.106:0/277653102 shutdown_connections 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/277653102 >> v2:172.21.15.171:3300/0 conn(0x7fbb700b0ac0 0x7fbb700afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/277653102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb700679d0 0x7fbb700b4a80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 -- 172.21.15.106:0/277653102 >> 172.21.15.106:0/277653102 conn(0x7fbb700b9ca0 msgr2=0x7fbb700ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 -- 172.21.15.106:0/277653102 shutdown_connections 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.570+0000 7fbb75fa8640 1 -- 172.21.15.106:0/277653102 wait complete. 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 Processor -- start 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 -- start start 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb700679d0 0x7fbb701cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb7009fb60 0x7fbb7013ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb700b0ac0 0x7fbb70140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70145450 con 0x7fbb7009fb60 2024-04-16T12:58:13.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbb700b57d0 con 0x7fbb700679d0 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb75fa8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbb701455d0 con 0x7fbb700b0ac0 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.571+0000 7fbb6effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb7009fb60 0x7fbb7013ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb7009fb60 0x7fbb7013ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59456/0 (socket says 172.21.15.106:59456) 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 -- 172.21.15.106:0/2183316381 learned_addr learned my addr 172.21.15.106:0/2183316381 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6f7fe640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb700679d0 0x7fbb701cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6ffff640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb700b0ac0 0x7fbb70140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 -- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb700b0ac0 msgr2=0x7fbb70140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb700b0ac0 0x7fbb70140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 -- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb700679d0 msgr2=0x7fbb701cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb700679d0 0x7fbb701cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 -- 172.21.15.106:0/2183316381 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb701d09c0 con 0x7fbb7009fb60 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb6effd640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb7009fb60 0x7fbb7013ff20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400b410 tx=0x7fbb6400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb57fff640 1 -- 172.21.15.106:0/2183316381 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64015020 con 0x7fbb7009fb60 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb57fff640 1 -- 172.21.15.106:0/2183316381 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb64011850 con 0x7fbb7009fb60 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb57fff640 1 -- 172.21.15.106:0/2183316381 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64011c40 con 0x7fbb7009fb60 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb70145b80 con 0x7fbb7009fb60 2024-04-16T12:58:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.572+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb701ce190 con 0x7fbb7009fb60 2024-04-16T12:58:13.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.573+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb70072b70 con 0x7fbb7009fb60 2024-04-16T12:58:13.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.574+0000 7fbb57fff640 1 -- 172.21.15.106:0/2183316381 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb64018020 con 0x7fbb7009fb60 2024-04-16T12:58:13.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.574+0000 7fbb57fff640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbb5c06c8f0 0x7fbb5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.574+0000 7fbb57fff640 1 -- 172.21.15.106:0/2183316381 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fbb6408b9c0 con 0x7fbb7009fb60 2024-04-16T12:58:13.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.574+0000 7fbb6f7fe640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbb5c06c8f0 0x7fbb5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.574+0000 7fbb6f7fe640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbb5c06c8f0 0x7fbb5c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb60035000 tx=0x7fbb60030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.578+0000 7fbb57fff640 1 -- 172.21.15.106:0/2183316381 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb70072b70 con 0x7fbb7009fb60 2024-04-16T12:58:13.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.755+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fbb70068a90 con 0x7fbb5c06c8f0 2024-04-16T12:58:13.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.756+0000 7fbb57fff640 1 -- 172.21.15.106:0/2183316381 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbb70068a90 con 0x7fbb5c06c8f0 2024-04-16T12:58:13.758 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 7 to deep-scrub 2024-04-16T12:58:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbb5c06c8f0 msgr2=0x7fbb5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbb5c06c8f0 0x7fbb5c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb60035000 tx=0x7fbb60030000 comp rx=0 tx=0).stop 2024-04-16T12:58:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb7009fb60 msgr2=0x7fbb7013ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb7009fb60 0x7fbb7013ff20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400b410 tx=0x7fbb6400b8d0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 shutdown_connections 2024-04-16T12:58:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fbb5c06c8f0 0x7fbb5c06edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb700b0ac0 0x7fbb70140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb7009fb60 0x7fbb7013ff20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 --2- 172.21.15.106:0/2183316381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb700679d0 0x7fbb701cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 >> 172.21.15.106:0/2183316381 conn(0x7fbb700b9ca0 msgr2=0x7fbb700b6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 shutdown_connections 2024-04-16T12:58:13.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.758+0000 7fbb75fa8640 1 -- 172.21.15.106:0/2183316381 wait complete. 2024-04-16T12:58:13.770 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:13.800 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-04-16T12:58:13.799+0000 7f603880a640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-16T12:58:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfcd346640 1 Processor -- start 2024-04-16T12:58:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfcd346640 1 -- start start 2024-04-16T12:58:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfcd346640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcfc80b63a0 0x7fcfc80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfcd346640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfcd346640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc8148b70 con 0x7fcfc81481c0 2024-04-16T12:58:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfcd346640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc80b4bd0 con 0x7fcfc80b63a0 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfcd346640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc80b4eb0 con 0x7fcfc8148670 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfc6ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcfc80b63a0 0x7fcfc80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfc6ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcfc80b63a0 0x7fcfc80b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59458/0 (socket says 172.21.15.106:59458) 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.875+0000 7fcfc6ffd640 1 -- 172.21.15.106:0/3307120813 learned_addr learned my addr 172.21.15.106:0/3307120813 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.876+0000 7fcfc77fe640 1 --2- 172.21.15.106:0/3307120813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.876+0000 7fcfc6ffd640 1 -- 172.21.15.106:0/3307120813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 msgr2=0x7fcfc80b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.876+0000 7fcfc6ffd640 1 --2- 172.21.15.106:0/3307120813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc80b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.876+0000 7fcfc6ffd640 1 -- 172.21.15.106:0/3307120813 >> v1:172.21.15.171:6789/0 conn(0x7fcfc81481c0 legacy=0x7fcfc81418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.876+0000 7fcfc6ffd640 1 -- 172.21.15.106:0/3307120813 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc8141fb0 con 0x7fcfc80b63a0 2024-04-16T12:58:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.876+0000 7fcfc6ffd640 1 --2- 172.21.15.106:0/3307120813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc80b63a0 0x7fcfc80b6780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009e50 tx=0x7fcfc002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ec2049ccc995a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfc5ffb640 1 -- 172.21.15.106:0/3307120813 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc002ca70 con 0x7fcfc80b63a0 2024-04-16T12:58:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfc5ffb640 1 -- 172.21.15.106:0/3307120813 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc002cc10 con 0x7fcfc80b63a0 2024-04-16T12:58:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfc5ffb640 1 -- 172.21.15.106:0/3307120813 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00343f0 con 0x7fcfc80b63a0 2024-04-16T12:58:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 -- 172.21.15.106:0/3307120813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc80b63a0 msgr2=0x7fcfc80b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 --2- 172.21.15.106:0/3307120813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc80b63a0 0x7fcfc80b6780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009e50 tx=0x7fcfc002bed0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 -- 172.21.15.106:0/3307120813 shutdown_connections 2024-04-16T12:58:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 --2- 172.21.15.106:0/3307120813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc80b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 --2- 172.21.15.106:0/3307120813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc80b63a0 0x7fcfc80b6780 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 -- 172.21.15.106:0/3307120813 >> 172.21.15.106:0/3307120813 conn(0x7fcfc8068080 msgr2=0x7fcfc80bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 -- 172.21.15.106:0/3307120813 shutdown_connections 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.877+0000 7fcfcd346640 1 -- 172.21.15.106:0/3307120813 wait complete. 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.878+0000 7fcfcd346640 1 Processor -- start 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.878+0000 7fcfcd346640 1 -- start start 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfcd346640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfc80b63a0 0x7fcfc813f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfcd346640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc81481c0 0x7fcfc813ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfcd346640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc814aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfcd346640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80b5d20 con 0x7fcfc81481c0 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfcd346640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80b5ba0 con 0x7fcfc80b63a0 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfcd346640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc8152610 con 0x7fcfc8148670 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc81481c0 0x7fcfc813ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc81481c0 0x7fcfc813ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59472/0 (socket says 172.21.15.106:59472) 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 -- 172.21.15.106:0/2385178740 learned_addr learned my addr 172.21.15.106:0/2385178740 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc6ffd640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfc80b63a0 0x7fcfc813f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc77fe640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc814aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 -- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 msgr2=0x7fcfc814aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc814aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 -- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfc80b63a0 msgr2=0x7fcfc813f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfc80b63a0 0x7fcfc813f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.879+0000 7fcfc67fc640 1 -- 172.21.15.106:0/2385178740 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc8149660 con 0x7fcfc81481c0 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.880+0000 7fcfc67fc640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc81481c0 0x7fcfc813ad40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c400 tx=0x7fcfb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.880+0000 7fcfbf7fe640 1 -- 172.21.15.106:0/2385178740 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00052d0 con 0x7fcfc81481c0 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.880+0000 7fcfbf7fe640 1 -- 172.21.15.106:0/2385178740 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb0005490 con 0x7fcfc81481c0 2024-04-16T12:58:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.880+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc8149940 con 0x7fcfc81481c0 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.880+0000 7fcfbf7fe640 1 -- 172.21.15.106:0/2385178740 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0007260 con 0x7fcfc81481c0 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.880+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc8141610 con 0x7fcfc81481c0 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.881+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc8068a90 con 0x7fcfc81481c0 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.881+0000 7fcfbf7fe640 1 -- 172.21.15.106:0/2385178740 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcfb0007400 con 0x7fcfc81481c0 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.881+0000 7fcfbf7fe640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcfa806c8f0 0x7fcfa806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.882+0000 7fcfbf7fe640 1 -- 172.21.15.106:0/2385178740 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5795+0+0 (secure 0 0 0) 0x7fcfb008b000 con 0x7fcfc81481c0 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.882+0000 7fcfc6ffd640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcfa806c8f0 0x7fcfa806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.882+0000 7fcfc6ffd640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcfa806c8f0 0x7fcfa806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0035000 tx=0x7fcfc0030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:13.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:13.886+0000 7fcfbf7fe640 1 -- 172.21.15.106:0/2385178740 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcfb0058e10 con 0x7fcfc81481c0 2024-04-16T12:58:14.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.058+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcfc8149b10 con 0x7fcfa806c8f0 2024-04-16T12:58:14.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.064+0000 7fcfbf7fe640 1 -- 172.21.15.106:0/2385178740 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251055 (secure 0 0 0) 0x7fcfc8149b10 con 0x7fcfa806c8f0 2024-04-16T12:58:14.068 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:14.069 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:14.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcfa806c8f0 msgr2=0x7fcfa806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:14.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcfa806c8f0 0x7fcfa806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0035000 tx=0x7fcfc0030000 comp rx=0 tx=0).stop 2024-04-16T12:58:14.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc81481c0 msgr2=0x7fcfc813ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:14.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc81481c0 0x7fcfc813ad40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c400 tx=0x7fcfb000c8c0 comp rx=0 tx=0).stop 2024-04-16T12:58:14.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 shutdown_connections 2024-04-16T12:58:14.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fcfa806c8f0 0x7fcfa806edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:14.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfc8148670 0x7fcfc814aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:14.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfc81481c0 0x7fcfc813ad40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:14.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 --2- 172.21.15.106:0/2385178740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfc80b63a0 0x7fcfc813f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:14.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 >> 172.21.15.106:0/2385178740 conn(0x7fcfc8068080 msgr2=0x7fcfc80bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:14.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 shutdown_connections 2024-04-16T12:58:14.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:14.067+0000 7fcfcd346640 1 -- 172.21.15.106:0/2385178740 wait complete. 2024-04-16T12:58:14.079 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-16T12:58:13.791207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3842048,"data_stored":2177652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.617858"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557061+0000","last_change":"2024-04-16T12:57:58.417066+0000","last_active":"2024-04-16T12:57:59.557061+0000","last_peered":"2024-04-16T12:57:59.557061+0000","last_clean":"2024-04-16T12:57:59.557061+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:57:59.557061+0000","last_undegraded":"2024-04-16T12:57:59.557061+0000","last_fullsized":"2024-04-16T12:57:59.557061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:40.783094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557293+0000","last_change":"2024-04-16T12:57:58.414223+0000","last_active":"2024-04-16T12:57:59.557293+0000","last_peered":"2024-04-16T12:57:59.557293+0000","last_clean":"2024-04-16T12:57:59.557293+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:57:59.557293+0000","last_undegraded":"2024-04-16T12:57:59.557293+0000","last_fullsized":"2024-04-16T12:57:59.557293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:04.064696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408863+0000","last_change":"2024-04-16T12:57:58.429706+0000","last_active":"2024-04-16T12:57:59.408863+0000","last_peered":"2024-04-16T12:57:59.408863+0000","last_clean":"2024-04-16T12:57:59.408863+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:57:59.408863+0000","last_undegraded":"2024-04-16T12:57:59.408863+0000","last_fullsized":"2024-04-16T12:57:59.408863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191814+0000","last_change":"2024-04-16T12:57:58.432119+0000","last_active":"2024-04-16T12:58:01.191814+0000","last_peered":"2024-04-16T12:58:01.191814+0000","last_clean":"2024-04-16T12:58:01.191814+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:58:01.191814+0000","last_undegraded":"2024-04-16T12:58:01.191814+0000","last_fullsized":"2024-04-16T12:58:01.191814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557573+0000","last_change":"2024-04-16T12:57:58.415012+0000","last_active":"2024-04-16T12:57:59.557573+0000","last_peered":"2024-04-16T12:57:59.557573+0000","last_clean":"2024-04-16T12:57:59.557573+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:57:59.557573+0000","last_undegraded":"2024-04-16T12:57:59.557573+0000","last_fullsized":"2024-04-16T12:57:59.557573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:02.447913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556831+0000","last_change":"2024-04-16T12:57:58.423617+0000","last_active":"2024-04-16T12:57:59.556831+0000","last_peered":"2024-04-16T12:57:59.556831+0000","last_clean":"2024-04-16T12:57:59.556831+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:57:59.556831+0000","last_undegraded":"2024-04-16T12:57:59.556831+0000","last_fullsized":"2024-04-16T12:57:59.556831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409523+0000","last_change":"2024-04-16T12:57:58.421176+0000","last_active":"2024-04-16T12:57:59.409523+0000","last_peered":"2024-04-16T12:57:59.409523+0000","last_clean":"2024-04-16T12:57:59.409523+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:57:59.409523+0000","last_undegraded":"2024-04-16T12:57:59.409523+0000","last_fullsized":"2024-04-16T12:57:59.409523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408717+0000","last_change":"2024-04-16T12:57:58.420336+0000","last_active":"2024-04-16T12:57:59.408717+0000","last_peered":"2024-04-16T12:57:59.408717+0000","last_clean":"2024-04-16T12:57:59.408717+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:57:59.408717+0000","last_undegraded":"2024-04-16T12:57:59.408717+0000","last_fullsized":"2024-04-16T12:57:59.408717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:00.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557536+0000","last_change":"2024-04-16T12:57:58.427221+0000","last_active":"2024-04-16T12:57:59.557536+0000","last_peered":"2024-04-16T12:57:59.557536+0000","last_clean":"2024-04-16T12:57:59.557536+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:57:59.557536+0000","last_undegraded":"2024-04-16T12:57:59.557536+0000","last_fullsized":"2024-04-16T12:57:59.557536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.268801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191877+0000","last_change":"2024-04-16T12:57:58.414532+0000","last_active":"2024-04-16T12:58:01.191877+0000","last_peered":"2024-04-16T12:58:01.191877+0000","last_clean":"2024-04-16T12:58:01.191877+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:58:01.191877+0000","last_undegraded":"2024-04-16T12:58:01.191877+0000","last_fullsized":"2024-04-16T12:58:01.191877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409656+0000","last_change":"2024-04-16T12:57:58.419590+0000","last_active":"2024-04-16T12:57:59.409656+0000","last_peered":"2024-04-16T12:57:59.409656+0000","last_clean":"2024-04-16T12:57:59.409656+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:57:59.409656+0000","last_undegraded":"2024-04-16T12:57:59.409656+0000","last_fullsized":"2024-04-16T12:57:59.409656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408763+0000","last_change":"2024-04-16T12:57:58.420968+0000","last_active":"2024-04-16T12:57:59.408763+0000","last_peered":"2024-04-16T12:57:59.408763+0000","last_clean":"2024-04-16T12:57:59.408763+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:57:59.408763+0000","last_undegraded":"2024-04-16T12:57:59.408763+0000","last_fullsized":"2024-04-16T12:57:59.408763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557659+0000","last_change":"2024-04-16T12:57:58.424597+0000","last_active":"2024-04-16T12:57:59.557659+0000","last_peered":"2024-04-16T12:57:59.557659+0000","last_clean":"2024-04-16T12:57:59.557659+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:57:59.557659+0000","last_undegraded":"2024-04-16T12:57:59.557659+0000","last_fullsized":"2024-04-16T12:57:59.557659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:58.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556986+0000","last_change":"2024-04-16T12:57:58.411816+0000","last_active":"2024-04-16T12:57:59.556986+0000","last_peered":"2024-04-16T12:57:59.556986+0000","last_clean":"2024-04-16T12:57:59.556986+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:57:59.556986+0000","last_undegraded":"2024-04-16T12:57:59.556986+0000","last_fullsized":"2024-04-16T12:57:59.556986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408901+0000","last_change":"2024-04-16T12:57:58.419271+0000","last_active":"2024-04-16T12:57:59.408901+0000","last_peered":"2024-04-16T12:57:59.408901+0000","last_clean":"2024-04-16T12:57:59.408901+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:57:59.408901+0000","last_undegraded":"2024-04-16T12:57:59.408901+0000","last_fullsized":"2024-04-16T12:57:59.408901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409323+0000","last_change":"2024-04-16T12:57:58.421606+0000","last_active":"2024-04-16T12:57:59.409323+0000","last_peered":"2024-04-16T12:57:59.409323+0000","last_clean":"2024-04-16T12:57:59.409323+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:57:59.409323+0000","last_undegraded":"2024-04-16T12:57:59.409323+0000","last_fullsized":"2024-04-16T12:57:59.409323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409307+0000","last_change":"2024-04-16T12:57:58.421726+0000","last_active":"2024-04-16T12:57:59.409307+0000","last_peered":"2024-04-16T12:57:59.409307+0000","last_clean":"2024-04-16T12:57:59.409307+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:57:59.409307+0000","last_undegraded":"2024-04-16T12:57:59.409307+0000","last_fullsized":"2024-04-16T12:57:59.409307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557302+0000","last_change":"2024-04-16T12:57:58.417403+0000","last_active":"2024-04-16T12:57:59.557302+0000","last_peered":"2024-04-16T12:57:59.557302+0000","last_clean":"2024-04-16T12:57:59.557302+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:57:59.557302+0000","last_undegraded":"2024-04-16T12:57:59.557302+0000","last_fullsized":"2024-04-16T12:57:59.557302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:24.189968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556932+0000","last_change":"2024-04-16T12:57:58.423377+0000","last_active":"2024-04-16T12:57:59.556932+0000","last_peered":"2024-04-16T12:57:59.556932+0000","last_clean":"2024-04-16T12:57:59.556932+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:57:59.556932+0000","last_undegraded":"2024-04-16T12:57:59.556932+0000","last_fullsized":"2024-04-16T12:57:59.556932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:00.429362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557686+0000","last_change":"2024-04-16T12:57:58.422790+0000","last_active":"2024-04-16T12:57:59.557686+0000","last_peered":"2024-04-16T12:57:59.557686+0000","last_clean":"2024-04-16T12:57:59.557686+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:57:59.557686+0000","last_undegraded":"2024-04-16T12:57:59.557686+0000","last_fullsized":"2024-04-16T12:57:59.557686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:04.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557897+0000","last_change":"2024-04-16T12:57:58.432630+0000","last_active":"2024-04-16T12:57:59.557897+0000","last_peered":"2024-04-16T12:57:59.557897+0000","last_clean":"2024-04-16T12:57:59.557897+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:57:59.557897+0000","last_undegraded":"2024-04-16T12:57:59.557897+0000","last_fullsized":"2024-04-16T12:57:59.557897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:42.955900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557157+0000","last_change":"2024-04-16T12:57:58.428165+0000","last_active":"2024-04-16T12:57:59.557157+0000","last_peered":"2024-04-16T12:57:59.557157+0000","last_clean":"2024-04-16T12:57:59.557157+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:57:59.557157+0000","last_undegraded":"2024-04-16T12:57:59.557157+0000","last_fullsized":"2024-04-16T12:57:59.557157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:10.267977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193356+0000","last_change":"2024-04-16T12:57:58.419322+0000","last_active":"2024-04-16T12:58:01.193356+0000","last_peered":"2024-04-16T12:58:01.193356+0000","last_clean":"2024-04-16T12:58:01.193356+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:58:01.193356+0000","last_undegraded":"2024-04-16T12:58:01.193356+0000","last_fullsized":"2024-04-16T12:58:01.193356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408594+0000","last_change":"2024-04-16T12:57:58.425245+0000","last_active":"2024-04-16T12:57:59.408594+0000","last_peered":"2024-04-16T12:57:59.408594+0000","last_clean":"2024-04-16T12:57:59.408594+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:57:59.408594+0000","last_undegraded":"2024-04-16T12:57:59.408594+0000","last_fullsized":"2024-04-16T12:57:59.408594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191890+0000","last_change":"2024-04-16T12:57:58.422256+0000","last_active":"2024-04-16T12:58:01.191890+0000","last_peered":"2024-04-16T12:58:01.191890+0000","last_clean":"2024-04-16T12:58:01.191890+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:58:01.191890+0000","last_undegraded":"2024-04-16T12:58:01.191890+0000","last_fullsized":"2024-04-16T12:58:01.191890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557449+0000","last_change":"2024-04-16T12:57:58.421697+0000","last_active":"2024-04-16T12:57:59.557449+0000","last_peered":"2024-04-16T12:57:59.557449+0000","last_clean":"2024-04-16T12:57:59.557449+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:57:59.557449+0000","last_undegraded":"2024-04-16T12:57:59.557449+0000","last_fullsized":"2024-04-16T12:57:59.557449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:39.008329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191852+0000","last_change":"2024-04-16T12:57:58.429064+0000","last_active":"2024-04-16T12:58:01.191852+0000","last_peered":"2024-04-16T12:58:01.191852+0000","last_clean":"2024-04-16T12:58:01.191852+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:58:01.191852+0000","last_undegraded":"2024-04-16T12:58:01.191852+0000","last_fullsized":"2024-04-16T12:58:01.191852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408814+0000","last_change":"2024-04-16T12:57:58.420144+0000","last_active":"2024-04-16T12:57:59.408814+0000","last_peered":"2024-04-16T12:57:59.408814+0000","last_clean":"2024-04-16T12:57:59.408814+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:57:59.408814+0000","last_undegraded":"2024-04-16T12:57:59.408814+0000","last_fullsized":"2024-04-16T12:57:59.408814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557851+0000","last_change":"2024-04-16T12:57:58.428551+0000","last_active":"2024-04-16T12:57:59.557851+0000","last_peered":"2024-04-16T12:57:59.557851+0000","last_clean":"2024-04-16T12:57:59.557851+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:57:59.557851+0000","last_undegraded":"2024-04-16T12:57:59.557851+0000","last_fullsized":"2024-04-16T12:57:59.557851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:02.265351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408962+0000","last_change":"2024-04-16T12:57:58.419164+0000","last_active":"2024-04-16T12:57:59.408962+0000","last_peered":"2024-04-16T12:57:59.408962+0000","last_clean":"2024-04-16T12:57:59.408962+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:57:59.408962+0000","last_undegraded":"2024-04-16T12:57:59.408962+0000","last_fullsized":"2024-04-16T12:57:59.408962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:02.216271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557022+0000","last_change":"2024-04-16T12:57:58.417480+0000","last_active":"2024-04-16T12:57:59.557022+0000","last_peered":"2024-04-16T12:57:59.557022+0000","last_clean":"2024-04-16T12:57:59.557022+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:57:59.557022+0000","last_undegraded":"2024-04-16T12:57:59.557022+0000","last_fullsized":"2024-04-16T12:57:59.557022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:55:29.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408880+0000","last_change":"2024-04-16T12:57:58.429121+0000","last_active":"2024-04-16T12:57:59.408880+0000","last_peered":"2024-04-16T12:57:59.408880+0000","last_clean":"2024-04-16T12:57:59.408880+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:57:59.408880+0000","last_undegraded":"2024-04-16T12:57:59.408880+0000","last_fullsized":"2024-04-16T12:57:59.408880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.529728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193406+0000","last_change":"2024-04-16T12:57:58.425769+0000","last_active":"2024-04-16T12:58:01.193406+0000","last_peered":"2024-04-16T12:58:01.193406+0000","last_clean":"2024-04-16T12:58:01.193406+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:58:01.193406+0000","last_undegraded":"2024-04-16T12:58:01.193406+0000","last_fullsized":"2024-04-16T12:58:01.193406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557168+0000","last_change":"2024-04-16T12:57:57.419875+0000","last_active":"2024-04-16T12:57:59.557168+0000","last_peered":"2024-04-16T12:57:59.557168+0000","last_clean":"2024-04-16T12:57:59.557168+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:57:59.557168+0000","last_undegraded":"2024-04-16T12:57:59.557168+0000","last_fullsized":"2024-04-16T12:57:59.557168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556949+0000","last_change":"2024-04-16T12:57:58.429507+0000","last_active":"2024-04-16T12:57:59.556949+0000","last_peered":"2024-04-16T12:57:59.556949+0000","last_clean":"2024-04-16T12:57:59.556949+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:57:59.556949+0000","last_undegraded":"2024-04-16T12:57:59.556949+0000","last_fullsized":"2024-04-16T12:57:59.556949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:48.320225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:10.763234+0000","last_change":"2024-04-16T12:58:10.763273+0000","last_active":"2024-04-16T12:58:10.763234+0000","last_peered":"2024-04-16T12:58:10.763234+0000","last_clean":"2024-04-16T12:58:10.763234+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:58:10.763234+0000","last_undegraded":"2024-04-16T12:58:10.763234+0000","last_fullsized":"2024-04-16T12:58:10.763234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-04-16T12:58:10.763152+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-04-16T12:58:10.763152+0000","last_clean_scrub_stamp":"2024-04-16T12:58:10.763152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:15.630546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557564+0000","last_change":"2024-04-16T12:57:58.430344+0000","last_active":"2024-04-16T12:57:59.557564+0000","last_peered":"2024-04-16T12:57:59.557564+0000","last_clean":"2024-04-16T12:57:59.557564+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:57:59.557564+0000","last_undegraded":"2024-04-16T12:57:59.557564+0000","last_fullsized":"2024-04-16T12:57:59.557564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:24.936280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557003+0000","last_change":"2024-04-16T12:57:57.421388+0000","last_active":"2024-04-16T12:57:59.557003+0000","last_peered":"2024-04-16T12:57:59.557003+0000","last_clean":"2024-04-16T12:57:59.557003+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:57:59.557003+0000","last_undegraded":"2024-04-16T12:57:59.557003+0000","last_fullsized":"2024-04-16T12:57:59.557003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:23.928523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191865+0000","last_change":"2024-04-16T12:57:58.427164+0000","last_active":"2024-04-16T12:58:01.191865+0000","last_peered":"2024-04-16T12:58:01.191865+0000","last_clean":"2024-04-16T12:58:01.191865+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:58:01.191865+0000","last_undegraded":"2024-04-16T12:58:01.191865+0000","last_fullsized":"2024-04-16T12:58:01.191865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557793+0000","last_change":"2024-04-16T12:57:57.419891+0000","last_active":"2024-04-16T12:57:59.557793+0000","last_peered":"2024-04-16T12:57:59.557793+0000","last_clean":"2024-04-16T12:57:59.557793+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:57:59.557793+0000","last_undegraded":"2024-04-16T12:57:59.557793+0000","last_fullsized":"2024-04-16T12:57:59.557793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:38:48.386771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409438+0000","last_change":"2024-04-16T12:57:58.428187+0000","last_active":"2024-04-16T12:57:59.409438+0000","last_peered":"2024-04-16T12:57:59.409438+0000","last_clean":"2024-04-16T12:57:59.409438+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:57:59.409438+0000","last_undegraded":"2024-04-16T12:57:59.409438+0000","last_fullsized":"2024-04-16T12:57:59.409438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:56.029832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557927+0000","last_change":"2024-04-16T12:57:57.419136+0000","last_active":"2024-04-16T12:57:59.557927+0000","last_peered":"2024-04-16T12:57:59.557927+0000","last_clean":"2024-04-16T12:57:59.557927+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:57:59.557927+0000","last_undegraded":"2024-04-16T12:57:59.557927+0000","last_fullsized":"2024-04-16T12:57:59.557927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:43.373507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408786+0000","last_change":"2024-04-16T12:57:58.428624+0000","last_active":"2024-04-16T12:57:59.408786+0000","last_peered":"2024-04-16T12:57:59.408786+0000","last_clean":"2024-04-16T12:57:59.408786+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:57:59.408786+0000","last_undegraded":"2024-04-16T12:57:59.408786+0000","last_fullsized":"2024-04-16T12:57:59.408786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557287+0000","last_change":"2024-04-16T12:57:57.418607+0000","last_active":"2024-04-16T12:57:59.557287+0000","last_peered":"2024-04-16T12:57:59.557287+0000","last_clean":"2024-04-16T12:57:59.557287+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:57:59.557287+0000","last_undegraded":"2024-04-16T12:57:59.557287+0000","last_fullsized":"2024-04-16T12:57:59.557287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:17.248246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556971+0000","last_change":"2024-04-16T12:57:58.426553+0000","last_active":"2024-04-16T12:57:59.556971+0000","last_peered":"2024-04-16T12:57:59.556971+0000","last_clean":"2024-04-16T12:57:59.556971+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:57:59.556971+0000","last_undegraded":"2024-04-16T12:57:59.556971+0000","last_fullsized":"2024-04-16T12:57:59.556971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:37.727657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556800+0000","last_change":"2024-04-16T12:57:57.418496+0000","last_active":"2024-04-16T12:57:59.556800+0000","last_peered":"2024-04-16T12:57:59.556800+0000","last_clean":"2024-04-16T12:57:59.556800+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:57:59.556800+0000","last_undegraded":"2024-04-16T12:57:59.556800+0000","last_fullsized":"2024-04-16T12:57:59.556800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191750+0000","last_change":"2024-04-16T12:57:58.421803+0000","last_active":"2024-04-16T12:58:01.191750+0000","last_peered":"2024-04-16T12:58:01.191750+0000","last_clean":"2024-04-16T12:58:01.191750+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:58:01.191750+0000","last_undegraded":"2024-04-16T12:58:01.191750+0000","last_fullsized":"2024-04-16T12:58:01.191750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557158+0000","last_change":"2024-04-16T12:57:57.417993+0000","last_active":"2024-04-16T12:57:59.557158+0000","last_peered":"2024-04-16T12:57:59.557158+0000","last_clean":"2024-04-16T12:57:59.557158+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:57:59.557158+0000","last_undegraded":"2024-04-16T12:57:59.557158+0000","last_fullsized":"2024-04-16T12:57:59.557158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:27:27.583239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409611+0000","last_change":"2024-04-16T12:57:58.421729+0000","last_active":"2024-04-16T12:57:59.409611+0000","last_peered":"2024-04-16T12:57:59.409611+0000","last_clean":"2024-04-16T12:57:59.409611+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:57:59.409611+0000","last_undegraded":"2024-04-16T12:57:59.409611+0000","last_fullsized":"2024-04-16T12:57:59.409611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556740+0000","last_change":"2024-04-16T12:57:57.419936+0000","last_active":"2024-04-16T12:57:59.556740+0000","last_peered":"2024-04-16T12:57:59.556740+0000","last_clean":"2024-04-16T12:57:59.556740+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:57:59.556740+0000","last_undegraded":"2024-04-16T12:57:59.556740+0000","last_fullsized":"2024-04-16T12:57:59.556740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:09.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556761+0000","last_change":"2024-04-16T12:57:58.423776+0000","last_active":"2024-04-16T12:57:59.556761+0000","last_peered":"2024-04-16T12:57:59.556761+0000","last_clean":"2024-04-16T12:57:59.556761+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:57:59.556761+0000","last_undegraded":"2024-04-16T12:57:59.556761+0000","last_fullsized":"2024-04-16T12:57:59.556761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:15.519977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193419+0000","last_change":"2024-04-16T12:57:57.418768+0000","last_active":"2024-04-16T12:58:01.193419+0000","last_peered":"2024-04-16T12:58:01.193419+0000","last_clean":"2024-04-16T12:58:01.193419+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:58:01.193419+0000","last_undegraded":"2024-04-16T12:58:01.193419+0000","last_fullsized":"2024-04-16T12:58:01.193419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557137+0000","last_change":"2024-04-16T12:57:58.421105+0000","last_active":"2024-04-16T12:57:59.557137+0000","last_peered":"2024-04-16T12:57:59.557137+0000","last_clean":"2024-04-16T12:57:59.557137+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:57:59.557137+0000","last_undegraded":"2024-04-16T12:57:59.557137+0000","last_fullsized":"2024-04-16T12:57:59.557137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408991+0000","last_change":"2024-04-16T12:57:57.416238+0000","last_active":"2024-04-16T12:57:59.408991+0000","last_peered":"2024-04-16T12:57:59.408991+0000","last_clean":"2024-04-16T12:57:59.408991+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:57:59.408991+0000","last_undegraded":"2024-04-16T12:57:59.408991+0000","last_fullsized":"2024-04-16T12:57:59.408991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:32:36.719900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408608+0000","last_change":"2024-04-16T12:57:58.428014+0000","last_active":"2024-04-16T12:57:59.408608+0000","last_peered":"2024-04-16T12:57:59.408608+0000","last_clean":"2024-04-16T12:57:59.408608+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:57:59.408608+0000","last_undegraded":"2024-04-16T12:57:59.408608+0000","last_fullsized":"2024-04-16T12:57:59.408608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557150+0000","last_change":"2024-04-16T12:57:57.421382+0000","last_active":"2024-04-16T12:57:59.557150+0000","last_peered":"2024-04-16T12:57:59.557150+0000","last_clean":"2024-04-16T12:57:59.557150+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:57:59.557150+0000","last_undegraded":"2024-04-16T12:57:59.557150+0000","last_fullsized":"2024-04-16T12:57:59.557150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:18:09.260220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191777+0000","last_change":"2024-04-16T12:57:58.417617+0000","last_active":"2024-04-16T12:58:01.191777+0000","last_peered":"2024-04-16T12:58:01.191777+0000","last_clean":"2024-04-16T12:58:01.191777+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:58:01.191777+0000","last_undegraded":"2024-04-16T12:58:01.191777+0000","last_fullsized":"2024-04-16T12:58:01.191777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.558015+0000","last_change":"2024-04-16T12:57:57.419094+0000","last_active":"2024-04-16T12:57:59.558015+0000","last_peered":"2024-04-16T12:57:59.558015+0000","last_clean":"2024-04-16T12:57:59.558015+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:57:59.558015+0000","last_undegraded":"2024-04-16T12:57:59.558015+0000","last_fullsized":"2024-04-16T12:57:59.558015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557010+0000","last_change":"2024-04-16T12:57:58.414688+0000","last_active":"2024-04-16T12:57:59.557010+0000","last_peered":"2024-04-16T12:57:59.557010+0000","last_clean":"2024-04-16T12:57:59.557010+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:57:59.557010+0000","last_undegraded":"2024-04-16T12:57:59.557010+0000","last_fullsized":"2024-04-16T12:57:59.557010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191789+0000","last_change":"2024-04-16T12:57:57.416542+0000","last_active":"2024-04-16T12:58:01.191789+0000","last_peered":"2024-04-16T12:58:01.191789+0000","last_clean":"2024-04-16T12:58:01.191789+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:58:01.191789+0000","last_undegraded":"2024-04-16T12:58:01.191789+0000","last_fullsized":"2024-04-16T12:58:01.191789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409146+0000","last_change":"2024-04-16T12:57:58.429363+0000","last_active":"2024-04-16T12:57:59.409146+0000","last_peered":"2024-04-16T12:57:59.409146+0000","last_clean":"2024-04-16T12:57:59.409146+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:57:59.409146+0000","last_undegraded":"2024-04-16T12:57:59.409146+0000","last_fullsized":"2024-04-16T12:57:59.409146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:03:54.661912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557034+0000","last_change":"2024-04-16T12:57:57.417272+0000","last_active":"2024-04-16T12:57:59.557034+0000","last_peered":"2024-04-16T12:57:59.557034+0000","last_clean":"2024-04-16T12:57:59.557034+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:57:59.557034+0000","last_undegraded":"2024-04-16T12:57:59.557034+0000","last_fullsized":"2024-04-16T12:57:59.557034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:19.085142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:58.428318+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:20.092899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556658+0000","last_change":"2024-04-16T12:57:57.418665+0000","last_active":"2024-04-16T12:57:59.556658+0000","last_peered":"2024-04-16T12:57:59.556658+0000","last_clean":"2024-04-16T12:57:59.556658+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:57:59.556658+0000","last_undegraded":"2024-04-16T12:57:59.556658+0000","last_fullsized":"2024-04-16T12:57:59.556658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:39.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557740+0000","last_change":"2024-04-16T12:57:58.424884+0000","last_active":"2024-04-16T12:57:59.557740+0000","last_peered":"2024-04-16T12:57:59.557740+0000","last_clean":"2024-04-16T12:57:59.557740+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:57:59.557740+0000","last_undegraded":"2024-04-16T12:57:59.557740+0000","last_fullsized":"2024-04-16T12:57:59.557740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:26.298781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191902+0000","last_change":"2024-04-16T12:57:57.417511+0000","last_active":"2024-04-16T12:58:01.191902+0000","last_peered":"2024-04-16T12:58:01.191902+0000","last_clean":"2024-04-16T12:58:01.191902+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:58:01.191902+0000","last_undegraded":"2024-04-16T12:58:01.191902+0000","last_fullsized":"2024-04-16T12:58:01.191902+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409706+0000","last_change":"2024-04-16T12:57:58.431315+0000","last_active":"2024-04-16T12:57:59.409706+0000","last_peered":"2024-04-16T12:57:59.409706+0000","last_clean":"2024-04-16T12:57:59.409706+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:57:59.409706+0000","last_undegraded":"2024-04-16T12:57:59.409706+0000","last_fullsized":"2024-04-16T12:57:59.409706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:20.546415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557710+0000","last_change":"2024-04-16T12:57:57.419368+0000","last_active":"2024-04-16T12:57:59.557710+0000","last_peered":"2024-04-16T12:57:59.557710+0000","last_clean":"2024-04-16T12:57:59.557710+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:57:59.557710+0000","last_undegraded":"2024-04-16T12:57:59.557710+0000","last_fullsized":"2024-04-16T12:57:59.557710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191827+0000","last_change":"2024-04-16T12:57:58.431490+0000","last_active":"2024-04-16T12:58:01.191827+0000","last_peered":"2024-04-16T12:58:01.191827+0000","last_clean":"2024-04-16T12:58:01.191827+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:58:01.191827+0000","last_undegraded":"2024-04-16T12:58:01.191827+0000","last_fullsized":"2024-04-16T12:58:01.191827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557329+0000","last_change":"2024-04-16T12:57:57.418637+0000","last_active":"2024-04-16T12:57:59.557329+0000","last_peered":"2024-04-16T12:57:59.557329+0000","last_clean":"2024-04-16T12:57:59.557329+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:57:59.557329+0000","last_undegraded":"2024-04-16T12:57:59.557329+0000","last_fullsized":"2024-04-16T12:57:59.557329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:49.553356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557676+0000","last_change":"2024-04-16T12:57:58.420291+0000","last_active":"2024-04-16T12:57:59.557676+0000","last_peered":"2024-04-16T12:57:59.557676+0000","last_clean":"2024-04-16T12:57:59.557676+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:57:59.557676+0000","last_undegraded":"2024-04-16T12:57:59.557676+0000","last_fullsized":"2024-04-16T12:57:59.557676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557561+0000","last_change":"2024-04-16T12:57:57.420173+0000","last_active":"2024-04-16T12:57:59.557561+0000","last_peered":"2024-04-16T12:57:59.557561+0000","last_clean":"2024-04-16T12:57:59.557561+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:57:59.557561+0000","last_undegraded":"2024-04-16T12:57:59.557561+0000","last_fullsized":"2024-04-16T12:57:59.557561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:15:01.440156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556745+0000","last_change":"2024-04-16T12:57:58.428239+0000","last_active":"2024-04-16T12:57:59.556745+0000","last_peered":"2024-04-16T12:57:59.556745+0000","last_clean":"2024-04-16T12:57:59.556745+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:57:59.556745+0000","last_undegraded":"2024-04-16T12:57:59.556745+0000","last_fullsized":"2024-04-16T12:57:59.556745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:18.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193381+0000","last_change":"2024-04-16T12:57:57.416742+0000","last_active":"2024-04-16T12:58:01.193381+0000","last_peered":"2024-04-16T12:58:01.193381+0000","last_clean":"2024-04-16T12:58:01.193381+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:58:01.193381+0000","last_undegraded":"2024-04-16T12:58:01.193381+0000","last_fullsized":"2024-04-16T12:58:01.193381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557717+0000","last_change":"2024-04-16T12:57:58.415256+0000","last_active":"2024-04-16T12:57:59.557717+0000","last_peered":"2024-04-16T12:57:59.557717+0000","last_clean":"2024-04-16T12:57:59.557717+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:57:59.557717+0000","last_undegraded":"2024-04-16T12:57:59.557717+0000","last_fullsized":"2024-04-16T12:57:59.557717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:06:44.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557212+0000","last_change":"2024-04-16T12:57:57.418163+0000","last_active":"2024-04-16T12:57:59.557212+0000","last_peered":"2024-04-16T12:57:59.557212+0000","last_clean":"2024-04-16T12:57:59.557212+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:57:59.557212+0000","last_undegraded":"2024-04-16T12:57:59.557212+0000","last_fullsized":"2024-04-16T12:57:59.557212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:03.286142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556520+0000","last_change":"2024-04-16T12:57:58.422113+0000","last_active":"2024-04-16T12:57:59.556520+0000","last_peered":"2024-04-16T12:57:59.556520+0000","last_clean":"2024-04-16T12:57:59.556520+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:57:59.556520+0000","last_undegraded":"2024-04-16T12:57:59.556520+0000","last_fullsized":"2024-04-16T12:57:59.556520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:50.561113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557093+0000","last_change":"2024-04-16T12:57:57.420836+0000","last_active":"2024-04-16T12:57:59.557093+0000","last_peered":"2024-04-16T12:57:59.557093+0000","last_clean":"2024-04-16T12:57:59.557093+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:57:59.557093+0000","last_undegraded":"2024-04-16T12:57:59.557093+0000","last_fullsized":"2024-04-16T12:57:59.557093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:20.906783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409271+0000","last_change":"2024-04-16T12:57:58.418246+0000","last_active":"2024-04-16T12:57:59.409271+0000","last_peered":"2024-04-16T12:57:59.409271+0000","last_clean":"2024-04-16T12:57:59.409271+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:57:59.409271+0000","last_undegraded":"2024-04-16T12:57:59.409271+0000","last_fullsized":"2024-04-16T12:57:59.409271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:08.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408689+0000","last_change":"2024-04-16T12:57:57.415493+0000","last_active":"2024-04-16T12:57:59.408689+0000","last_peered":"2024-04-16T12:57:59.408689+0000","last_clean":"2024-04-16T12:57:59.408689+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:57:59.408689+0000","last_undegraded":"2024-04-16T12:57:59.408689+0000","last_fullsized":"2024-04-16T12:57:59.408689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557558+0000","last_change":"2024-04-16T12:57:58.424345+0000","last_active":"2024-04-16T12:57:59.557558+0000","last_peered":"2024-04-16T12:57:59.557558+0000","last_clean":"2024-04-16T12:57:59.557558+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:57:59.557558+0000","last_undegraded":"2024-04-16T12:57:59.557558+0000","last_fullsized":"2024-04-16T12:57:59.557558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:44.705042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191924+0000","last_change":"2024-04-16T12:57:57.419610+0000","last_active":"2024-04-16T12:58:01.191924+0000","last_peered":"2024-04-16T12:58:01.191924+0000","last_clean":"2024-04-16T12:58:01.191924+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:58:01.191924+0000","last_undegraded":"2024-04-16T12:58:01.191924+0000","last_fullsized":"2024-04-16T12:58:01.191924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409731+0000","last_change":"2024-04-16T12:57:58.428160+0000","last_active":"2024-04-16T12:57:59.409731+0000","last_peered":"2024-04-16T12:57:59.409731+0000","last_clean":"2024-04-16T12:57:59.409731+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:57:59.409731+0000","last_undegraded":"2024-04-16T12:57:59.409731+0000","last_fullsized":"2024-04-16T12:57:59.409731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:07.325324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193425+0000","last_change":"2024-04-16T12:57:57.415967+0000","last_active":"2024-04-16T12:58:01.193425+0000","last_peered":"2024-04-16T12:58:01.193425+0000","last_clean":"2024-04-16T12:58:01.193425+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:58:01.193425+0000","last_undegraded":"2024-04-16T12:58:01.193425+0000","last_fullsized":"2024-04-16T12:58:01.193425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193399+0000","last_change":"2024-04-16T12:57:58.419642+0000","last_active":"2024-04-16T12:58:01.193399+0000","last_peered":"2024-04-16T12:58:01.193399+0000","last_clean":"2024-04-16T12:58:01.193399+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:58:01.193399+0000","last_undegraded":"2024-04-16T12:58:01.193399+0000","last_fullsized":"2024-04-16T12:58:01.193399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191839+0000","last_change":"2024-04-16T12:57:57.416214+0000","last_active":"2024-04-16T12:58:01.191839+0000","last_peered":"2024-04-16T12:58:01.191839+0000","last_clean":"2024-04-16T12:58:01.191839+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:58:01.191839+0000","last_undegraded":"2024-04-16T12:58:01.191839+0000","last_fullsized":"2024-04-16T12:58:01.191839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557237+0000","last_change":"2024-04-16T12:57:58.420763+0000","last_active":"2024-04-16T12:57:59.557237+0000","last_peered":"2024-04-16T12:57:59.557237+0000","last_clean":"2024-04-16T12:57:59.557237+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:57:59.557237+0000","last_undegraded":"2024-04-16T12:57:59.557237+0000","last_fullsized":"2024-04-16T12:57:59.557237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193390+0000","last_change":"2024-04-16T12:57:57.413675+0000","last_active":"2024-04-16T12:58:01.193390+0000","last_peered":"2024-04-16T12:58:01.193390+0000","last_clean":"2024-04-16T12:58:01.193390+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:58:01.193390+0000","last_undegraded":"2024-04-16T12:58:01.193390+0000","last_fullsized":"2024-04-16T12:58:01.193390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.193373+0000","last_change":"2024-04-16T12:57:58.417795+0000","last_active":"2024-04-16T12:58:01.193373+0000","last_peered":"2024-04-16T12:58:01.193373+0000","last_clean":"2024-04-16T12:58:01.193373+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:58:01.193373+0000","last_undegraded":"2024-04-16T12:58:01.193373+0000","last_fullsized":"2024-04-16T12:58:01.193373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:58:01.191801+0000","last_change":"2024-04-16T12:57:57.418446+0000","last_active":"2024-04-16T12:58:01.191801+0000","last_peered":"2024-04-16T12:58:01.191801+0000","last_clean":"2024-04-16T12:58:01.191801+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:58:01.191801+0000","last_undegraded":"2024-04-16T12:58:01.191801+0000","last_fullsized":"2024-04-16T12:58:01.191801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556666+0000","last_change":"2024-04-16T12:57:58.415348+0000","last_active":"2024-04-16T12:57:59.556666+0000","last_peered":"2024-04-16T12:57:59.556666+0000","last_clean":"2024-04-16T12:57:59.556666+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:57:59.556666+0000","last_undegraded":"2024-04-16T12:57:59.556666+0000","last_fullsized":"2024-04-16T12:57:59.556666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:55.379426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.557259+0000","last_change":"2024-04-16T12:57:57.424470+0000","last_active":"2024-04-16T12:57:59.557259+0000","last_peered":"2024-04-16T12:57:59.557259+0000","last_clean":"2024-04-16T12:57:59.557259+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:57:59.557259+0000","last_undegraded":"2024-04-16T12:57:59.557259+0000","last_fullsized":"2024-04-16T12:57:59.557259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:29:43.697285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556938+0000","last_change":"2024-04-16T12:57:58.428240+0000","last_active":"2024-04-16T12:57:59.556938+0000","last_peered":"2024-04-16T12:57:59.556938+0000","last_clean":"2024-04-16T12:57:59.556938+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:57:59.556938+0000","last_undegraded":"2024-04-16T12:57:59.556938+0000","last_fullsized":"2024-04-16T12:57:59.556938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:06.234868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556773+0000","last_change":"2024-04-16T12:57:57.416527+0000","last_active":"2024-04-16T12:57:59.556773+0000","last_peered":"2024-04-16T12:57:59.556773+0000","last_clean":"2024-04-16T12:57:59.556773+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:57:59.556773+0000","last_undegraded":"2024-04-16T12:57:59.556773+0000","last_fullsized":"2024-04-16T12:57:59.556773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:05.227111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.408749+0000","last_change":"2024-04-16T12:57:58.422936+0000","last_active":"2024-04-16T12:57:59.408749+0000","last_peered":"2024-04-16T12:57:59.408749+0000","last_clean":"2024-04-16T12:57:59.408749+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:57:59.408749+0000","last_undegraded":"2024-04-16T12:57:59.408749+0000","last_fullsized":"2024-04-16T12:57:59.408749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:57.397957+0000","last_clean_scrub_stamp":"2024-04-16T12:57:57.397957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:20.131823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.556749+0000","last_change":"2024-04-16T12:57:57.418379+0000","last_active":"2024-04-16T12:57:59.556749+0000","last_peered":"2024-04-16T12:57:59.556749+0000","last_clean":"2024-04-16T12:57:59.556749+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:57:59.556749+0000","last_undegraded":"2024-04-16T12:57:59.556749+0000","last_fullsized":"2024-04-16T12:57:59.556749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:56.390200+0000","last_clean_scrub_stamp":"2024-04-16T12:57:56.390200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:57.951633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-16T12:57:59.409385+0000","last_change":"2024-04-16T12:57:07.324589+0000","last_active":"2024-04-16T12:57:59.409385+0000","last_peered":"2024-04-16T12:57:59.409385+0000","last_clean":"2024-04-16T12:57:59.409385+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:57:59.409385+0000","last_undegraded":"2024-04-16T12:57:59.409385+0000","last_fullsized":"2024-04-16T12:57:59.409385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:57:06.244945+0000","last_clean_scrub_stamp":"2024-04-16T12:57:06.244945+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:57.520170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":714470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":124082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":125646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":714380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:14.085 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.086 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.086 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.086 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.086 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.086 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.086 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.086 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.087 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.087 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.087 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.087 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.087 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.087 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.088 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.088 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.088 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.088 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.088 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.088 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.089 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.089 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.089 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.089 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.089 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.089 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.090 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.090 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.090 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.090 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.090 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.090 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.091 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.091 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.091 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.091 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.091 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.091 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.092 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.092 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.092 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.092 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.092 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.092 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.093 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.093 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.093 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.093 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.093 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.093 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.093 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.094 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.094 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.094 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.094 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.094 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.095 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.095 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.095 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.095 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.095 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.095 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.096 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.096 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.096 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.096 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.096 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.096 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.096 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.097 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.097 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.097 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.097 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.097 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.097 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.098 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.098 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.098 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.098 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.098 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.098 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.099 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.099 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.099 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.099 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.099 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.099 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.100 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.100 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.100 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.100 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.100 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.100 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.101 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T12:57:57.397957+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=57, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.101 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-16T12:57:56.390200+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.101 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T12:57:06.244945+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=57, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=58, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:58:14.101 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T12:58:15.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2024-04-16T12:58:18.395 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-04-16T12:58:18.393+0000 7f603c812640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T12:58:18.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:58:18.938 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:58:21.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~19s 2024-04-16T12:58:28.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2024-04-16T12:58:34.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:58:34.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.215+0000 7f495cd31640 1 Processor -- start 2024-04-16T12:58:34.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.215+0000 7f495cd31640 1 -- start start 2024-04-16T12:58:34.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f495cd31640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f49580b6780 0x7f49581418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f495cd31640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4958141de0 0x7f49580b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f495cd31640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49581488d0 con 0x7f49580b63a0 2024-04-16T12:58:34.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f495cd31640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4958148b70 con 0x7f49580b6780 2024-04-16T12:58:34.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f495cd31640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f49580b4bd0 con 0x7f4958141de0 2024-04-16T12:58:34.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f4955d9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f49580b6780 0x7f49581418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f495659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f49580b63a0 0x7f49581481c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51800/0 (socket says 172.21.15.106:51800) 2024-04-16T12:58:34.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f4955d9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f49580b6780 0x7f49581418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55820/0 (socket says 172.21.15.106:55820) 2024-04-16T12:58:34.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.216+0000 7f495659c640 1 -- 172.21.15.106:0/3542992948 learned_addr learned my addr 172.21.15.106:0/3542992948 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:34.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f4956d9d640 1 --2- 172.21.15.106:0/3542992948 >> v2:172.21.15.171:3300/0 conn(0x7f4958141de0 0x7f49580b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f4955d9b640 1 -- 172.21.15.106:0/3542992948 >> v2:172.21.15.171:3300/0 conn(0x7f4958141de0 msgr2=0x7f49580b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:34.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f4955d9b640 1 --2- 172.21.15.106:0/3542992948 >> v2:172.21.15.171:3300/0 conn(0x7f4958141de0 0x7f49580b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f4955d9b640 1 -- 172.21.15.106:0/3542992948 >> v1:172.21.15.106:6789/0 conn(0x7f49580b63a0 legacy=0x7f49581481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f495559a640 1 -- 172.21.15.106:0/3542992948 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420215329 0 0) 0x7f49581488d0 con 0x7f49580b63a0 2024-04-16T12:58:34.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f4955d9b640 1 -- 172.21.15.106:0/3542992948 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49580b4eb0 con 0x7f49580b6780 2024-04-16T12:58:34.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f4955d9b640 1 --2- 172.21.15.106:0/3542992948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b6780 0x7f49581418a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f49580b9b40 tx=0x7f494002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cda015d05b7ad30 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f495559a640 1 -- 172.21.15.106:0/3542992948 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49400315a0 con 0x7f49580b6780 2024-04-16T12:58:34.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.217+0000 7f495559a640 1 -- 172.21.15.106:0/3542992948 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4940037070 con 0x7f49580b6780 2024-04-16T12:58:34.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495559a640 1 -- 172.21.15.106:0/3542992948 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940031960 con 0x7f49580b6780 2024-04-16T12:58:34.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 -- 172.21.15.106:0/3542992948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b6780 msgr2=0x7f49581418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 --2- 172.21.15.106:0/3542992948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b6780 0x7f49581418a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f49580b9b40 tx=0x7f494002b840 comp rx=0 tx=0).stop 2024-04-16T12:58:34.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 -- 172.21.15.106:0/3542992948 shutdown_connections 2024-04-16T12:58:34.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 --2- 172.21.15.106:0/3542992948 >> v2:172.21.15.171:3300/0 conn(0x7f4958141de0 0x7f49580b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 --2- 172.21.15.106:0/3542992948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b6780 0x7f49581418a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 -- 172.21.15.106:0/3542992948 >> 172.21.15.106:0/3542992948 conn(0x7f4958068080 msgr2=0x7f49580bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:34.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 -- 172.21.15.106:0/3542992948 shutdown_connections 2024-04-16T12:58:34.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.218+0000 7f495cd31640 1 -- 172.21.15.106:0/3542992948 wait complete. 2024-04-16T12:58:34.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.219+0000 7f495cd31640 1 Processor -- start 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.219+0000 7f495cd31640 1 -- start start 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495cd31640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b63a0 0x7f49580bc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495cd31640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49580b6780 0x7f49581dd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495cd31640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4958141de0 0x7f49581e0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495cd31640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f49580b5ce0 con 0x7f49580b63a0 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495cd31640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49580b5b60 con 0x7f4958141de0 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495cd31640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4958152610 con 0x7f49580b6780 2024-04-16T12:58:34.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b63a0 0x7f49580bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b63a0 0x7f49580bc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55824/0 (socket says 172.21.15.106:55824) 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 -- 172.21.15.106:0/3070463732 learned_addr learned my addr 172.21.15.106:0/3070463732 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f4956d9d640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4958141de0 0x7f49581e0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f4955d9b640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49580b6780 0x7f49581dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 -- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49580b6780 msgr2=0x7f49581dd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49580b6780 0x7f49581dd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 -- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4958141de0 msgr2=0x7f49581e0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4958141de0 0x7f49581e0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f495659c640 1 -- 172.21.15.106:0/3070463732 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495813f8d0 con 0x7f49580b63a0 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.220+0000 7f4956d9d640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4958141de0 0x7f49581e0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.221+0000 7f495659c640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b63a0 0x7f49580bc740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f494800cc10 tx=0x7f494800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.221+0000 7f494effd640 1 -- 172.21.15.106:0/3070463732 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948017070 con 0x7f49580b63a0 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.221+0000 7f494effd640 1 -- 172.21.15.106:0/3070463732 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494800ce20 con 0x7f49580b63a0 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.221+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4958144fa0 con 0x7f49580b63a0 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.221+0000 7f494effd640 1 -- 172.21.15.106:0/3070463732 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948012640 con 0x7f49580b63a0 2024-04-16T12:58:34.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.221+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49581400f0 con 0x7f49580b63a0 2024-04-16T12:58:34.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.222+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4958068a90 con 0x7f49580b63a0 2024-04-16T12:58:34.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.222+0000 7f494effd640 1 -- 172.21.15.106:0/3070463732 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f494801a070 con 0x7f49580b63a0 2024-04-16T12:58:34.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.223+0000 7f494effd640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f493806c8f0 0x7f493806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.223+0000 7f494effd640 1 -- 172.21.15.106:0/3070463732 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5795+0+0 (secure 0 0 0) 0x7f494808b970 con 0x7f49580b63a0 2024-04-16T12:58:34.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.223+0000 7f4955d9b640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f493806c8f0 0x7f493806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.223+0000 7f4955d9b640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f493806c8f0 0x7f493806edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4940036000 tx=0x7f4940008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.227+0000 7f494effd640 1 -- 172.21.15.106:0/3070463732 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4948059dd0 con 0x7f49580b63a0 2024-04-16T12:58:34.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.403+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 --> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4958147510 con 0x7f493806c8f0 2024-04-16T12:58:34.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.409+0000 7f494effd640 1 -- 172.21.15.106:0/3070463732 <== mgr.4111 v2:172.21.15.106:6832/3856209158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251884 (secure 0 0 0) 0x7f4958147510 con 0x7f493806c8f0 2024-04-16T12:58:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:34.415 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-16T12:58:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f493806c8f0 msgr2=0x7f493806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f493806c8f0 0x7f493806edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4940036000 tx=0x7f4940008030 comp rx=0 tx=0).stop 2024-04-16T12:58:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b63a0 msgr2=0x7f49580bc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b63a0 0x7f49580bc740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f494800cc10 tx=0x7f494800a430 comp rx=0 tx=0).stop 2024-04-16T12:58:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 shutdown_connections 2024-04-16T12:58:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f493806c8f0 0x7f493806edb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4958141de0 0x7f49581e0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49580b6780 0x7f49581dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 --2- 172.21.15.106:0/3070463732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49580b63a0 0x7f49580bc740 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 >> 172.21.15.106:0/3070463732 conn(0x7f4958068080 msgr2=0x7f4958145c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 shutdown_connections 2024-04-16T12:58:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.412+0000 7f495cd31640 1 -- 172.21.15.106:0/3070463732 wait complete. 2024-04-16T12:58:34.425 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-16T12:58:34.180871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219976,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754744,"statfs":{"total":773094113280,"available":772868857856,"internally_reserved":0,"allocated":3940352,"data_stored":2226300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003040"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.720521+0000","last_change":"2024-04-16T12:58:16.720546+0000","last_active":"2024-04-16T12:58:16.720521+0000","last_peered":"2024-04-16T12:58:16.720521+0000","last_clean":"2024-04-16T12:58:16.720521+0000","last_became_active":"2024-04-16T12:57:58.416768+0000","last_became_peered":"2024-04-16T12:57:58.416768+0000","last_unstale":"2024-04-16T12:58:16.720521+0000","last_undegraded":"2024-04-16T12:58:16.720521+0000","last_fullsized":"2024-04-16T12:58:16.720521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:16.720416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:16.720416+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.720416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:21.538729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.803388+0000","last_change":"2024-04-16T12:58:12.536360+0000","last_active":"2024-04-16T12:58:13.803388+0000","last_peered":"2024-04-16T12:58:13.803388+0000","last_clean":"2024-04-16T12:58:13.803388+0000","last_became_active":"2024-04-16T12:57:58.413959+0000","last_became_peered":"2024-04-16T12:57:58.413959+0000","last_unstale":"2024-04-16T12:58:13.803388+0000","last_undegraded":"2024-04-16T12:58:13.803388+0000","last_fullsized":"2024-04-16T12:58:13.803388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:12.536258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:12.536258+0000","last_clean_scrub_stamp":"2024-04-16T12:58:12.536258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:07.763820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:23.555666+0000","last_change":"2024-04-16T12:58:23.555688+0000","last_active":"2024-04-16T12:58:23.555666+0000","last_peered":"2024-04-16T12:58:23.555666+0000","last_clean":"2024-04-16T12:58:23.555666+0000","last_became_active":"2024-04-16T12:57:58.429402+0000","last_became_peered":"2024-04-16T12:57:58.429402+0000","last_unstale":"2024-04-16T12:58:23.555666+0000","last_undegraded":"2024-04-16T12:58:23.555666+0000","last_fullsized":"2024-04-16T12:58:23.555666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:23.555572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:23.555572+0000","last_clean_scrub_stamp":"2024-04-16T12:58:23.555572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:26.849266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:23.230265+0000","last_change":"2024-04-16T12:58:23.230287+0000","last_active":"2024-04-16T12:58:23.230265+0000","last_peered":"2024-04-16T12:58:23.230265+0000","last_clean":"2024-04-16T12:58:23.230265+0000","last_became_active":"2024-04-16T12:57:58.430706+0000","last_became_peered":"2024-04-16T12:57:58.430706+0000","last_unstale":"2024-04-16T12:58:23.230265+0000","last_undegraded":"2024-04-16T12:58:23.230265+0000","last_fullsized":"2024-04-16T12:58:23.230265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:23.230176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:23.230176+0000","last_clean_scrub_stamp":"2024-04-16T12:58:23.230176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:33:20.687600+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.792579+0000","last_change":"2024-04-16T12:58:13.344174+0000","last_active":"2024-04-16T12:58:13.792579+0000","last_peered":"2024-04-16T12:58:13.792579+0000","last_clean":"2024-04-16T12:58:13.792579+0000","last_became_active":"2024-04-16T12:57:58.414016+0000","last_became_peered":"2024-04-16T12:57:58.414016+0000","last_unstale":"2024-04-16T12:58:13.792579+0000","last_undegraded":"2024-04-16T12:58:13.792579+0000","last_fullsized":"2024-04-16T12:58:13.792579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:13.344070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:13.344070+0000","last_clean_scrub_stamp":"2024-04-16T12:58:13.344070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:38:22.180980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:27.475854+0000","last_change":"2024-04-16T12:58:27.475880+0000","last_active":"2024-04-16T12:58:27.475854+0000","last_peered":"2024-04-16T12:58:27.475854+0000","last_clean":"2024-04-16T12:58:27.475854+0000","last_became_active":"2024-04-16T12:57:58.423318+0000","last_became_peered":"2024-04-16T12:57:58.423318+0000","last_unstale":"2024-04-16T12:58:27.475854+0000","last_undegraded":"2024-04-16T12:58:27.475854+0000","last_fullsized":"2024-04-16T12:58:27.475854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:27.475748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:27.475748+0000","last_clean_scrub_stamp":"2024-04-16T12:58:27.475748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:27.706341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:19.463943+0000","last_change":"2024-04-16T12:58:19.463978+0000","last_active":"2024-04-16T12:58:19.463943+0000","last_peered":"2024-04-16T12:58:19.463943+0000","last_clean":"2024-04-16T12:58:19.463943+0000","last_became_active":"2024-04-16T12:57:58.420815+0000","last_became_peered":"2024-04-16T12:57:58.420815+0000","last_unstale":"2024-04-16T12:58:19.463943+0000","last_undegraded":"2024-04-16T12:58:19.463943+0000","last_fullsized":"2024-04-16T12:58:19.463943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:19.463837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:19.463837+0000","last_clean_scrub_stamp":"2024-04-16T12:58:19.463837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:14:56.462242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.434945+0000","last_change":"2024-04-16T12:58:18.434971+0000","last_active":"2024-04-16T12:58:18.434945+0000","last_peered":"2024-04-16T12:58:18.434945+0000","last_clean":"2024-04-16T12:58:18.434945+0000","last_became_active":"2024-04-16T12:57:58.419965+0000","last_became_peered":"2024-04-16T12:57:58.419965+0000","last_unstale":"2024-04-16T12:58:18.434945+0000","last_undegraded":"2024-04-16T12:58:18.434945+0000","last_fullsized":"2024-04-16T12:58:18.434945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:18.434840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:18.434840+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.434840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:02.810903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:23.775658+0000","last_change":"2024-04-16T12:58:23.775699+0000","last_active":"2024-04-16T12:58:23.775658+0000","last_peered":"2024-04-16T12:58:23.775658+0000","last_clean":"2024-04-16T12:58:23.775658+0000","last_became_active":"2024-04-16T12:57:58.426964+0000","last_became_peered":"2024-04-16T12:57:58.426964+0000","last_unstale":"2024-04-16T12:58:23.775658+0000","last_undegraded":"2024-04-16T12:58:23.775658+0000","last_fullsized":"2024-04-16T12:58:23.775658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:23.775567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:23.775567+0000","last_clean_scrub_stamp":"2024-04-16T12:58:23.775567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:00.552135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.355914+0000","last_change":"2024-04-16T12:58:16.355945+0000","last_active":"2024-04-16T12:58:16.355914+0000","last_peered":"2024-04-16T12:58:16.355914+0000","last_clean":"2024-04-16T12:58:16.355914+0000","last_became_active":"2024-04-16T12:57:58.414222+0000","last_became_peered":"2024-04-16T12:57:58.414222+0000","last_unstale":"2024-04-16T12:58:16.355914+0000","last_undegraded":"2024-04-16T12:58:16.355914+0000","last_fullsized":"2024-04-16T12:58:16.355914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:16.355818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:16.355818+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.355818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:39.024127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.458549+0000","last_change":"2024-04-16T12:58:17.458574+0000","last_active":"2024-04-16T12:58:17.458549+0000","last_peered":"2024-04-16T12:58:17.458549+0000","last_clean":"2024-04-16T12:58:17.458549+0000","last_became_active":"2024-04-16T12:57:58.418413+0000","last_became_peered":"2024-04-16T12:57:58.418413+0000","last_unstale":"2024-04-16T12:58:17.458549+0000","last_undegraded":"2024-04-16T12:58:17.458549+0000","last_fullsized":"2024-04-16T12:58:17.458549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:17.458450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:17.458450+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.458450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:27:41.138772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.508626+0000","last_change":"2024-04-16T12:58:17.508690+0000","last_active":"2024-04-16T12:58:17.508626+0000","last_peered":"2024-04-16T12:58:17.508626+0000","last_clean":"2024-04-16T12:58:17.508626+0000","last_became_active":"2024-04-16T12:57:58.420636+0000","last_became_peered":"2024-04-16T12:57:58.420636+0000","last_unstale":"2024-04-16T12:58:17.508626+0000","last_undegraded":"2024-04-16T12:58:17.508626+0000","last_fullsized":"2024-04-16T12:58:17.508626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:17.508531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:17.508531+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.508531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:08.727177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:19.374442+0000","last_change":"2024-04-16T12:58:19.374468+0000","last_active":"2024-04-16T12:58:19.374442+0000","last_peered":"2024-04-16T12:58:19.374442+0000","last_clean":"2024-04-16T12:58:19.374442+0000","last_became_active":"2024-04-16T12:57:58.424327+0000","last_became_peered":"2024-04-16T12:57:58.424327+0000","last_unstale":"2024-04-16T12:58:19.374442+0000","last_undegraded":"2024-04-16T12:58:19.374442+0000","last_fullsized":"2024-04-16T12:58:19.374442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:19.374350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:19.374350+0000","last_clean_scrub_stamp":"2024-04-16T12:58:19.374350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:30.699140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:20.501651+0000","last_change":"2024-04-16T12:58:20.501672+0000","last_active":"2024-04-16T12:58:20.501651+0000","last_peered":"2024-04-16T12:58:20.501651+0000","last_clean":"2024-04-16T12:58:20.501651+0000","last_became_active":"2024-04-16T12:57:58.411566+0000","last_became_peered":"2024-04-16T12:57:58.411566+0000","last_unstale":"2024-04-16T12:58:20.501651+0000","last_undegraded":"2024-04-16T12:58:20.501651+0000","last_fullsized":"2024-04-16T12:58:20.501651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:20.501575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:20.501575+0000","last_clean_scrub_stamp":"2024-04-16T12:58:20.501575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:35.397985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:15.551525+0000","last_change":"2024-04-16T12:58:15.551554+0000","last_active":"2024-04-16T12:58:15.551525+0000","last_peered":"2024-04-16T12:58:15.551525+0000","last_clean":"2024-04-16T12:58:15.551525+0000","last_became_active":"2024-04-16T12:57:58.418990+0000","last_became_peered":"2024-04-16T12:57:58.418990+0000","last_unstale":"2024-04-16T12:58:15.551525+0000","last_undegraded":"2024-04-16T12:58:15.551525+0000","last_fullsized":"2024-04-16T12:58:15.551525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:15.551423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:15.551423+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.551423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:47.056642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:20.506192+0000","last_change":"2024-04-16T12:58:20.506246+0000","last_active":"2024-04-16T12:58:20.506192+0000","last_peered":"2024-04-16T12:58:20.506192+0000","last_clean":"2024-04-16T12:58:20.506192+0000","last_became_active":"2024-04-16T12:57:58.421332+0000","last_became_peered":"2024-04-16T12:57:58.421332+0000","last_unstale":"2024-04-16T12:58:20.506192+0000","last_undegraded":"2024-04-16T12:58:20.506192+0000","last_fullsized":"2024-04-16T12:58:20.506192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:20.506089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:20.506089+0000","last_clean_scrub_stamp":"2024-04-16T12:58:20.506089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:02:57.282658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:21.542021+0000","last_change":"2024-04-16T12:58:21.542046+0000","last_active":"2024-04-16T12:58:21.542021+0000","last_peered":"2024-04-16T12:58:21.542021+0000","last_clean":"2024-04-16T12:58:21.542021+0000","last_became_active":"2024-04-16T12:57:58.421462+0000","last_became_peered":"2024-04-16T12:57:58.421462+0000","last_unstale":"2024-04-16T12:58:21.542021+0000","last_undegraded":"2024-04-16T12:58:21.542021+0000","last_fullsized":"2024-04-16T12:58:21.542021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:21.541929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:21.541929+0000","last_clean_scrub_stamp":"2024-04-16T12:58:21.541929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:14.181038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:23.524896+0000","last_change":"2024-04-16T12:58:23.524933+0000","last_active":"2024-04-16T12:58:23.524896+0000","last_peered":"2024-04-16T12:58:23.524896+0000","last_clean":"2024-04-16T12:58:23.524896+0000","last_became_active":"2024-04-16T12:57:58.417165+0000","last_became_peered":"2024-04-16T12:57:58.417165+0000","last_unstale":"2024-04-16T12:58:23.524896+0000","last_undegraded":"2024-04-16T12:58:23.524896+0000","last_fullsized":"2024-04-16T12:58:23.524896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:23.524805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:23.524805+0000","last_clean_scrub_stamp":"2024-04-16T12:58:23.524805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:55:16.758967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:26.441530+0000","last_change":"2024-04-16T12:58:26.441555+0000","last_active":"2024-04-16T12:58:26.441530+0000","last_peered":"2024-04-16T12:58:26.441530+0000","last_clean":"2024-04-16T12:58:26.441530+0000","last_became_active":"2024-04-16T12:57:58.423118+0000","last_became_peered":"2024-04-16T12:57:58.423118+0000","last_unstale":"2024-04-16T12:58:26.441530+0000","last_undegraded":"2024-04-16T12:58:26.441530+0000","last_fullsized":"2024-04-16T12:58:26.441530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:26.441434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:26.441434+0000","last_clean_scrub_stamp":"2024-04-16T12:58:26.441434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:02.991725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.325163+0000","last_change":"2024-04-16T12:58:17.325191+0000","last_active":"2024-04-16T12:58:17.325163+0000","last_peered":"2024-04-16T12:58:17.325163+0000","last_clean":"2024-04-16T12:58:17.325163+0000","last_became_active":"2024-04-16T12:57:58.421864+0000","last_became_peered":"2024-04-16T12:57:58.421864+0000","last_unstale":"2024-04-16T12:58:17.325163+0000","last_undegraded":"2024-04-16T12:58:17.325163+0000","last_fullsized":"2024-04-16T12:58:17.325163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:17.325037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:17.325037+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.325037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:40.058903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:28.716159+0000","last_change":"2024-04-16T12:58:28.716185+0000","last_active":"2024-04-16T12:58:28.716159+0000","last_peered":"2024-04-16T12:58:28.716159+0000","last_clean":"2024-04-16T12:58:28.716159+0000","last_became_active":"2024-04-16T12:57:58.432362+0000","last_became_peered":"2024-04-16T12:57:58.432362+0000","last_unstale":"2024-04-16T12:58:28.716159+0000","last_undegraded":"2024-04-16T12:58:28.716159+0000","last_fullsized":"2024-04-16T12:58:28.716159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:28.716061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:28.716061+0000","last_clean_scrub_stamp":"2024-04-16T12:58:28.716061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:03.295882+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:24.771111+0000","last_change":"2024-04-16T12:58:24.771149+0000","last_active":"2024-04-16T12:58:24.771111+0000","last_peered":"2024-04-16T12:58:24.771111+0000","last_clean":"2024-04-16T12:58:24.771111+0000","last_became_active":"2024-04-16T12:57:58.427878+0000","last_became_peered":"2024-04-16T12:57:58.427878+0000","last_unstale":"2024-04-16T12:58:24.771111+0000","last_undegraded":"2024-04-16T12:58:24.771111+0000","last_fullsized":"2024-04-16T12:58:24.771111+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:24.770992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:24.770992+0000","last_clean_scrub_stamp":"2024-04-16T12:58:24.770992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:17.410102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.763421+0000","last_change":"2024-04-16T12:58:16.763456+0000","last_active":"2024-04-16T12:58:16.763421+0000","last_peered":"2024-04-16T12:58:16.763421+0000","last_clean":"2024-04-16T12:58:16.763421+0000","last_became_active":"2024-04-16T12:57:58.419045+0000","last_became_peered":"2024-04-16T12:57:58.419045+0000","last_unstale":"2024-04-16T12:58:16.763421+0000","last_undegraded":"2024-04-16T12:58:16.763421+0000","last_fullsized":"2024-04-16T12:58:16.763421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:16.763315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:16.763315+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.763315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:39.911773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:19.503301+0000","last_change":"2024-04-16T12:58:19.503323+0000","last_active":"2024-04-16T12:58:19.503301+0000","last_peered":"2024-04-16T12:58:19.503301+0000","last_clean":"2024-04-16T12:58:19.503301+0000","last_became_active":"2024-04-16T12:57:58.424975+0000","last_became_peered":"2024-04-16T12:57:58.424975+0000","last_unstale":"2024-04-16T12:58:19.503301+0000","last_undegraded":"2024-04-16T12:58:19.503301+0000","last_fullsized":"2024-04-16T12:58:19.503301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:19.503220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:19.503220+0000","last_clean_scrub_stamp":"2024-04-16T12:58:19.503220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:33:32.708477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:19.333663+0000","last_change":"2024-04-16T12:58:19.333710+0000","last_active":"2024-04-16T12:58:19.333663+0000","last_peered":"2024-04-16T12:58:19.333663+0000","last_clean":"2024-04-16T12:58:19.333663+0000","last_became_active":"2024-04-16T12:57:58.422014+0000","last_became_peered":"2024-04-16T12:57:58.422014+0000","last_unstale":"2024-04-16T12:58:19.333663+0000","last_undegraded":"2024-04-16T12:58:19.333663+0000","last_fullsized":"2024-04-16T12:58:19.333663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:19.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:19.333530+0000","last_clean_scrub_stamp":"2024-04-16T12:58:19.333530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:10.552175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:25.437436+0000","last_change":"2024-04-16T12:58:25.437462+0000","last_active":"2024-04-16T12:58:25.437436+0000","last_peered":"2024-04-16T12:58:25.437436+0000","last_clean":"2024-04-16T12:58:25.437436+0000","last_became_active":"2024-04-16T12:57:58.421452+0000","last_became_peered":"2024-04-16T12:57:58.421452+0000","last_unstale":"2024-04-16T12:58:25.437436+0000","last_undegraded":"2024-04-16T12:58:25.437436+0000","last_fullsized":"2024-04-16T12:58:25.437436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:25.437329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:25.437329+0000","last_clean_scrub_stamp":"2024-04-16T12:58:25.437329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:47.977984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:21.260845+0000","last_change":"2024-04-16T12:58:21.260883+0000","last_active":"2024-04-16T12:58:21.260845+0000","last_peered":"2024-04-16T12:58:21.260845+0000","last_clean":"2024-04-16T12:58:21.260845+0000","last_became_active":"2024-04-16T12:57:58.428781+0000","last_became_peered":"2024-04-16T12:57:58.428781+0000","last_unstale":"2024-04-16T12:58:21.260845+0000","last_undegraded":"2024-04-16T12:58:21.260845+0000","last_fullsized":"2024-04-16T12:58:21.260845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:21.260742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:21.260742+0000","last_clean_scrub_stamp":"2024-04-16T12:58:21.260742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:33:34.465999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.504614+0000","last_change":"2024-04-16T12:58:16.504654+0000","last_active":"2024-04-16T12:58:16.504614+0000","last_peered":"2024-04-16T12:58:16.504614+0000","last_clean":"2024-04-16T12:58:16.504614+0000","last_became_active":"2024-04-16T12:57:58.419879+0000","last_became_peered":"2024-04-16T12:57:58.419879+0000","last_unstale":"2024-04-16T12:58:16.504614+0000","last_undegraded":"2024-04-16T12:58:16.504614+0000","last_fullsized":"2024-04-16T12:58:16.504614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:16.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:16.504517+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:04:24.602078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:26.742155+0000","last_change":"2024-04-16T12:58:26.742182+0000","last_active":"2024-04-16T12:58:26.742155+0000","last_peered":"2024-04-16T12:58:26.742155+0000","last_clean":"2024-04-16T12:58:26.742155+0000","last_became_active":"2024-04-16T12:57:58.427718+0000","last_became_peered":"2024-04-16T12:57:58.427718+0000","last_unstale":"2024-04-16T12:58:26.742155+0000","last_undegraded":"2024-04-16T12:58:26.742155+0000","last_fullsized":"2024-04-16T12:58:26.742155+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:26.742049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:26.742049+0000","last_clean_scrub_stamp":"2024-04-16T12:58:26.742049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:31:23.516438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.500290+0000","last_change":"2024-04-16T12:58:16.500314+0000","last_active":"2024-04-16T12:58:16.500290+0000","last_peered":"2024-04-16T12:58:16.500290+0000","last_clean":"2024-04-16T12:58:16.500290+0000","last_became_active":"2024-04-16T12:57:58.418878+0000","last_became_peered":"2024-04-16T12:57:58.418878+0000","last_unstale":"2024-04-16T12:58:16.500290+0000","last_undegraded":"2024-04-16T12:58:16.500290+0000","last_fullsized":"2024-04-16T12:58:16.500290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:16.500201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:16.500201+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.500201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:59.850824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.685966+0000","last_change":"2024-04-16T12:58:17.686003+0000","last_active":"2024-04-16T12:58:17.685966+0000","last_peered":"2024-04-16T12:58:17.685966+0000","last_clean":"2024-04-16T12:58:17.685966+0000","last_became_active":"2024-04-16T12:57:58.416117+0000","last_became_peered":"2024-04-16T12:57:58.416117+0000","last_unstale":"2024-04-16T12:58:17.685966+0000","last_undegraded":"2024-04-16T12:58:17.685966+0000","last_fullsized":"2024-04-16T12:58:17.685966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:17.685868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:17.685868+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.685868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:38:29.010658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:24.517412+0000","last_change":"2024-04-16T12:58:24.517435+0000","last_active":"2024-04-16T12:58:24.517412+0000","last_peered":"2024-04-16T12:58:24.517412+0000","last_clean":"2024-04-16T12:58:24.517412+0000","last_became_active":"2024-04-16T12:57:58.428800+0000","last_became_peered":"2024-04-16T12:57:58.428800+0000","last_unstale":"2024-04-16T12:58:24.517412+0000","last_undegraded":"2024-04-16T12:58:24.517412+0000","last_fullsized":"2024-04-16T12:58:24.517412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:24.517314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:24.517314+0000","last_clean_scrub_stamp":"2024-04-16T12:58:24.517314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:39.413724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.755808+0000","last_change":"2024-04-16T12:58:18.755838+0000","last_active":"2024-04-16T12:58:18.755808+0000","last_peered":"2024-04-16T12:58:18.755808+0000","last_clean":"2024-04-16T12:58:18.755808+0000","last_became_active":"2024-04-16T12:57:58.425515+0000","last_became_peered":"2024-04-16T12:57:58.425515+0000","last_unstale":"2024-04-16T12:58:18.755808+0000","last_undegraded":"2024-04-16T12:58:18.755808+0000","last_fullsized":"2024-04-16T12:58:18.755808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:18.755721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:18.755721+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.755721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:00.366093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'5","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:15.706773+0000","last_change":"2024-04-16T12:58:15.706773+0000","last_active":"2024-04-16T12:58:15.706773+0000","last_peered":"2024-04-16T12:58:15.706773+0000","last_clean":"2024-04-16T12:58:15.706773+0000","last_became_active":"2024-04-16T12:57:57.419582+0000","last_became_peered":"2024-04-16T12:57:57.419582+0000","last_unstale":"2024-04-16T12:58:15.706773+0000","last_undegraded":"2024-04-16T12:58:15.706773+0000","last_fullsized":"2024-04-16T12:58:15.706773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-04-16T12:58:15.706638+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-04-16T12:58:15.706638+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.706638+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:38.440504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:20.701526+0000","last_change":"2024-04-16T12:58:20.701551+0000","last_active":"2024-04-16T12:58:20.701526+0000","last_peered":"2024-04-16T12:58:20.701526+0000","last_clean":"2024-04-16T12:58:20.701526+0000","last_became_active":"2024-04-16T12:57:58.429254+0000","last_became_peered":"2024-04-16T12:57:58.429254+0000","last_unstale":"2024-04-16T12:58:20.701526+0000","last_undegraded":"2024-04-16T12:58:20.701526+0000","last_fullsized":"2024-04-16T12:58:20.701526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:20.701433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:20.701433+0000","last_clean_scrub_stamp":"2024-04-16T12:58:20.701433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:30.628800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.799749+0000","last_change":"2024-04-16T12:58:10.763273+0000","last_active":"2024-04-16T12:58:13.799749+0000","last_peered":"2024-04-16T12:58:13.799749+0000","last_clean":"2024-04-16T12:58:13.799749+0000","last_became_active":"2024-04-16T12:57:57.409295+0000","last_became_peered":"2024-04-16T12:57:57.409295+0000","last_unstale":"2024-04-16T12:58:13.799749+0000","last_undegraded":"2024-04-16T12:58:13.799749+0000","last_fullsized":"2024-04-16T12:58:13.799749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-04-16T12:58:10.763152+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-04-16T12:58:10.763152+0000","last_clean_scrub_stamp":"2024-04-16T12:58:10.763152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:15.630546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:27.739343+0000","last_change":"2024-04-16T12:58:27.739387+0000","last_active":"2024-04-16T12:58:27.739343+0000","last_peered":"2024-04-16T12:58:27.739343+0000","last_clean":"2024-04-16T12:58:27.739343+0000","last_became_active":"2024-04-16T12:57:58.429984+0000","last_became_peered":"2024-04-16T12:57:58.429984+0000","last_unstale":"2024-04-16T12:58:27.739343+0000","last_undegraded":"2024-04-16T12:58:27.739343+0000","last_fullsized":"2024-04-16T12:58:27.739343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:27.739237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:27.739237+0000","last_clean_scrub_stamp":"2024-04-16T12:58:27.739237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:42.635647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:19.496406+0000","last_change":"2024-04-16T12:58:19.496434+0000","last_active":"2024-04-16T12:58:19.496406+0000","last_peered":"2024-04-16T12:58:19.496406+0000","last_clean":"2024-04-16T12:58:19.496406+0000","last_became_active":"2024-04-16T12:57:57.421124+0000","last_became_peered":"2024-04-16T12:57:57.421124+0000","last_unstale":"2024-04-16T12:58:19.496406+0000","last_undegraded":"2024-04-16T12:58:19.496406+0000","last_fullsized":"2024-04-16T12:58:19.496406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-16T12:58:19.496301+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-16T12:58:19.496301+0000","last_clean_scrub_stamp":"2024-04-16T12:58:19.496301+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:24:24.158120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:20.294738+0000","last_change":"2024-04-16T12:58:20.294765+0000","last_active":"2024-04-16T12:58:20.294738+0000","last_peered":"2024-04-16T12:58:20.294738+0000","last_clean":"2024-04-16T12:58:20.294738+0000","last_became_active":"2024-04-16T12:57:58.426640+0000","last_became_peered":"2024-04-16T12:57:58.426640+0000","last_unstale":"2024-04-16T12:58:20.294738+0000","last_undegraded":"2024-04-16T12:58:20.294738+0000","last_fullsized":"2024-04-16T12:58:20.294738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:20.294622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:20.294622+0000","last_clean_scrub_stamp":"2024-04-16T12:58:20.294622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:09.538079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.802729+0000","last_change":"2024-04-16T12:58:12.377128+0000","last_active":"2024-04-16T12:58:16.802729+0000","last_peered":"2024-04-16T12:58:16.802729+0000","last_clean":"2024-04-16T12:58:16.802729+0000","last_became_active":"2024-04-16T12:57:57.419611+0000","last_became_peered":"2024-04-16T12:57:57.419611+0000","last_unstale":"2024-04-16T12:58:16.802729+0000","last_undegraded":"2024-04-16T12:58:16.802729+0000","last_fullsized":"2024-04-16T12:58:16.802729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-16T12:58:12.377020+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-16T12:58:12.377020+0000","last_clean_scrub_stamp":"2024-04-16T12:58:12.377020+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:55.762156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:23.547066+0000","last_change":"2024-04-16T12:58:23.547089+0000","last_active":"2024-04-16T12:58:23.547066+0000","last_peered":"2024-04-16T12:58:23.547066+0000","last_clean":"2024-04-16T12:58:23.547066+0000","last_became_active":"2024-04-16T12:57:58.427865+0000","last_became_peered":"2024-04-16T12:57:58.427865+0000","last_unstale":"2024-04-16T12:58:23.547066+0000","last_undegraded":"2024-04-16T12:58:23.547066+0000","last_fullsized":"2024-04-16T12:58:23.547066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:23.546973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:23.546973+0000","last_clean_scrub_stamp":"2024-04-16T12:58:23.546973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:24:28.208791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.719977+0000","last_change":"2024-04-16T12:58:17.720006+0000","last_active":"2024-04-16T12:58:17.719977+0000","last_peered":"2024-04-16T12:58:17.719977+0000","last_clean":"2024-04-16T12:58:17.719977+0000","last_became_active":"2024-04-16T12:57:57.418864+0000","last_became_peered":"2024-04-16T12:57:57.418864+0000","last_unstale":"2024-04-16T12:58:17.719977+0000","last_undegraded":"2024-04-16T12:58:17.719977+0000","last_fullsized":"2024-04-16T12:58:17.719977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-16T12:58:17.719872+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-16T12:58:17.719872+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.719872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:59.330244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:22.511350+0000","last_change":"2024-04-16T12:58:22.511376+0000","last_active":"2024-04-16T12:58:22.511350+0000","last_peered":"2024-04-16T12:58:22.511350+0000","last_clean":"2024-04-16T12:58:22.511350+0000","last_became_active":"2024-04-16T12:57:58.427154+0000","last_became_peered":"2024-04-16T12:57:58.427154+0000","last_unstale":"2024-04-16T12:58:22.511350+0000","last_undegraded":"2024-04-16T12:58:22.511350+0000","last_fullsized":"2024-04-16T12:58:22.511350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:22.511259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:22.511259+0000","last_clean_scrub_stamp":"2024-04-16T12:58:22.511259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:04:17.950151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:14.681628+0000","last_change":"2024-04-16T12:58:14.681654+0000","last_active":"2024-04-16T12:58:14.681628+0000","last_peered":"2024-04-16T12:58:14.681628+0000","last_clean":"2024-04-16T12:58:14.681628+0000","last_became_active":"2024-04-16T12:57:57.418235+0000","last_became_peered":"2024-04-16T12:57:57.418235+0000","last_unstale":"2024-04-16T12:58:14.681628+0000","last_undegraded":"2024-04-16T12:58:14.681628+0000","last_fullsized":"2024-04-16T12:58:14.681628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-16T12:58:14.681537+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-16T12:58:14.681537+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.681537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:10:13.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:22.822813+0000","last_change":"2024-04-16T12:58:22.822859+0000","last_active":"2024-04-16T12:58:22.822813+0000","last_peered":"2024-04-16T12:58:22.822813+0000","last_clean":"2024-04-16T12:58:22.822813+0000","last_became_active":"2024-04-16T12:57:58.426172+0000","last_became_peered":"2024-04-16T12:57:58.426172+0000","last_unstale":"2024-04-16T12:58:22.822813+0000","last_undegraded":"2024-04-16T12:58:22.822813+0000","last_fullsized":"2024-04-16T12:58:22.822813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:22.822691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:22.822691+0000","last_clean_scrub_stamp":"2024-04-16T12:58:22.822691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:14:59.821096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:15.515124+0000","last_change":"2024-04-16T12:58:15.515170+0000","last_active":"2024-04-16T12:58:15.515124+0000","last_peered":"2024-04-16T12:58:15.515124+0000","last_clean":"2024-04-16T12:58:15.515124+0000","last_became_active":"2024-04-16T12:57:57.418236+0000","last_became_peered":"2024-04-16T12:57:57.418236+0000","last_unstale":"2024-04-16T12:58:15.515124+0000","last_undegraded":"2024-04-16T12:58:15.515124+0000","last_fullsized":"2024-04-16T12:58:15.515124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:15.515015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:15.515015+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.515015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:14:52.513420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.382184+0000","last_change":"2024-04-16T12:58:18.382242+0000","last_active":"2024-04-16T12:58:18.382184+0000","last_peered":"2024-04-16T12:58:18.382184+0000","last_clean":"2024-04-16T12:58:18.382184+0000","last_became_active":"2024-04-16T12:57:58.421375+0000","last_became_peered":"2024-04-16T12:57:58.421375+0000","last_unstale":"2024-04-16T12:58:18.382184+0000","last_undegraded":"2024-04-16T12:58:18.382184+0000","last_fullsized":"2024-04-16T12:58:18.382184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:18.382082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:18.382082+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.382082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:27:42.062404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.799408+0000","last_change":"2024-04-16T12:58:13.668255+0000","last_active":"2024-04-16T12:58:13.799408+0000","last_peered":"2024-04-16T12:58:13.799408+0000","last_clean":"2024-04-16T12:58:13.799408+0000","last_became_active":"2024-04-16T12:57:57.417678+0000","last_became_peered":"2024-04-16T12:57:57.417678+0000","last_unstale":"2024-04-16T12:58:13.799408+0000","last_undegraded":"2024-04-16T12:58:13.799408+0000","last_fullsized":"2024-04-16T12:58:13.799408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:13.668134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:13.668134+0000","last_clean_scrub_stamp":"2024-04-16T12:58:13.668134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:29:11.649603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.494111+0000","last_change":"2024-04-16T12:58:18.494136+0000","last_active":"2024-04-16T12:58:18.494111+0000","last_peered":"2024-04-16T12:58:18.494111+0000","last_clean":"2024-04-16T12:58:18.494111+0000","last_became_active":"2024-04-16T12:57:58.421458+0000","last_became_peered":"2024-04-16T12:57:58.421458+0000","last_unstale":"2024-04-16T12:58:18.494111+0000","last_undegraded":"2024-04-16T12:58:18.494111+0000","last_fullsized":"2024-04-16T12:58:18.494111+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:18.494020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:18.494020+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.494020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:07.737477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.509653+0000","last_change":"2024-04-16T12:58:17.509681+0000","last_active":"2024-04-16T12:58:17.509653+0000","last_peered":"2024-04-16T12:58:17.509653+0000","last_clean":"2024-04-16T12:58:17.509653+0000","last_became_active":"2024-04-16T12:57:57.419598+0000","last_became_peered":"2024-04-16T12:57:57.419598+0000","last_unstale":"2024-04-16T12:58:17.509653+0000","last_undegraded":"2024-04-16T12:58:17.509653+0000","last_fullsized":"2024-04-16T12:58:17.509653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:17.509567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:17.509567+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.509567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:25:17.020002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:28.525582+0000","last_change":"2024-04-16T12:58:28.525619+0000","last_active":"2024-04-16T12:58:28.525582+0000","last_peered":"2024-04-16T12:58:28.525582+0000","last_clean":"2024-04-16T12:58:28.525582+0000","last_became_active":"2024-04-16T12:57:58.423053+0000","last_became_peered":"2024-04-16T12:57:58.423053+0000","last_unstale":"2024-04-16T12:58:28.525582+0000","last_undegraded":"2024-04-16T12:58:28.525582+0000","last_fullsized":"2024-04-16T12:58:28.525582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:28.525481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:28.525481+0000","last_clean_scrub_stamp":"2024-04-16T12:58:28.525481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:04:39.080522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:14.767551+0000","last_change":"2024-04-16T12:58:14.767571+0000","last_active":"2024-04-16T12:58:14.767551+0000","last_peered":"2024-04-16T12:58:14.767551+0000","last_clean":"2024-04-16T12:58:14.767551+0000","last_became_active":"2024-04-16T12:57:57.418514+0000","last_became_peered":"2024-04-16T12:57:57.418514+0000","last_unstale":"2024-04-16T12:58:14.767551+0000","last_undegraded":"2024-04-16T12:58:14.767551+0000","last_fullsized":"2024-04-16T12:58:14.767551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:14.767476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:14.767476+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.767476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:29:12.748945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:24.484115+0000","last_change":"2024-04-16T12:58:24.484139+0000","last_active":"2024-04-16T12:58:24.484115+0000","last_peered":"2024-04-16T12:58:24.484115+0000","last_clean":"2024-04-16T12:58:24.484115+0000","last_became_active":"2024-04-16T12:57:58.420816+0000","last_became_peered":"2024-04-16T12:57:58.420816+0000","last_unstale":"2024-04-16T12:58:24.484115+0000","last_undegraded":"2024-04-16T12:58:24.484115+0000","last_fullsized":"2024-04-16T12:58:24.484115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:24.484022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:24.484022+0000","last_clean_scrub_stamp":"2024-04-16T12:58:24.484022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:31:56.489493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.799990+0000","last_change":"2024-04-16T12:58:14.511621+0000","last_active":"2024-04-16T12:58:16.799990+0000","last_peered":"2024-04-16T12:58:16.799990+0000","last_clean":"2024-04-16T12:58:16.799990+0000","last_became_active":"2024-04-16T12:57:57.415933+0000","last_became_peered":"2024-04-16T12:57:57.415933+0000","last_unstale":"2024-04-16T12:58:16.799990+0000","last_undegraded":"2024-04-16T12:58:16.799990+0000","last_fullsized":"2024-04-16T12:58:16.799990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-16T12:58:14.511438+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-16T12:58:14.511438+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.511438+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:43:37.179746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:20.501340+0000","last_change":"2024-04-16T12:58:20.501363+0000","last_active":"2024-04-16T12:58:20.501340+0000","last_peered":"2024-04-16T12:58:20.501340+0000","last_clean":"2024-04-16T12:58:20.501340+0000","last_became_active":"2024-04-16T12:57:58.427467+0000","last_became_peered":"2024-04-16T12:57:58.427467+0000","last_unstale":"2024-04-16T12:58:20.501340+0000","last_undegraded":"2024-04-16T12:58:20.501340+0000","last_fullsized":"2024-04-16T12:58:20.501340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:20.501217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:20.501217+0000","last_clean_scrub_stamp":"2024-04-16T12:58:20.501217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:44:13.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'7","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.506821+0000","last_change":"2024-04-16T12:58:18.506859+0000","last_active":"2024-04-16T12:58:18.506821+0000","last_peered":"2024-04-16T12:58:18.506821+0000","last_clean":"2024-04-16T12:58:18.506821+0000","last_became_active":"2024-04-16T12:57:57.421112+0000","last_became_peered":"2024-04-16T12:57:57.421112+0000","last_unstale":"2024-04-16T12:58:18.506821+0000","last_undegraded":"2024-04-16T12:58:18.506821+0000","last_fullsized":"2024-04-16T12:58:18.506821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-04-16T12:58:18.506735+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-04-16T12:58:18.506735+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.506735+0000","objects_scrubbed":4,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:33:15.964158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.403767+0000","last_change":"2024-04-16T12:58:17.403793+0000","last_active":"2024-04-16T12:58:17.403767+0000","last_peered":"2024-04-16T12:58:17.403767+0000","last_clean":"2024-04-16T12:58:17.403767+0000","last_became_active":"2024-04-16T12:57:58.417358+0000","last_became_peered":"2024-04-16T12:57:58.417358+0000","last_unstale":"2024-04-16T12:58:17.403767+0000","last_undegraded":"2024-04-16T12:58:17.403767+0000","last_fullsized":"2024-04-16T12:58:17.403767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:17.403653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:17.403653+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.403653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:12.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.673538+0000","last_change":"2024-04-16T12:58:16.673538+0000","last_active":"2024-04-16T12:58:16.673538+0000","last_peered":"2024-04-16T12:58:16.673538+0000","last_clean":"2024-04-16T12:58:16.673538+0000","last_became_active":"2024-04-16T12:57:57.418804+0000","last_became_peered":"2024-04-16T12:57:57.418804+0000","last_unstale":"2024-04-16T12:58:16.673538+0000","last_undegraded":"2024-04-16T12:58:16.673538+0000","last_fullsized":"2024-04-16T12:58:16.673538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-16T12:58:16.673380+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-16T12:58:16.673380+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.673380+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:23.340119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:21.481648+0000","last_change":"2024-04-16T12:58:21.481673+0000","last_active":"2024-04-16T12:58:21.481648+0000","last_peered":"2024-04-16T12:58:21.481648+0000","last_clean":"2024-04-16T12:58:21.481648+0000","last_became_active":"2024-04-16T12:57:58.414440+0000","last_became_peered":"2024-04-16T12:57:58.414440+0000","last_unstale":"2024-04-16T12:58:21.481648+0000","last_undegraded":"2024-04-16T12:58:21.481648+0000","last_fullsized":"2024-04-16T12:58:21.481648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:21.481554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:21.481554+0000","last_clean_scrub_stamp":"2024-04-16T12:58:21.481554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:56.061376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.800059+0000","last_change":"2024-04-16T12:58:12.354047+0000","last_active":"2024-04-16T12:58:13.800059+0000","last_peered":"2024-04-16T12:58:13.800059+0000","last_clean":"2024-04-16T12:58:13.800059+0000","last_became_active":"2024-04-16T12:57:57.416294+0000","last_became_peered":"2024-04-16T12:57:57.416294+0000","last_unstale":"2024-04-16T12:58:13.800059+0000","last_undegraded":"2024-04-16T12:58:13.800059+0000","last_fullsized":"2024-04-16T12:58:13.800059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:12.353940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:12.353940+0000","last_clean_scrub_stamp":"2024-04-16T12:58:12.353940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:32.037373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:25.537425+0000","last_change":"2024-04-16T12:58:25.537462+0000","last_active":"2024-04-16T12:58:25.537425+0000","last_peered":"2024-04-16T12:58:25.537425+0000","last_clean":"2024-04-16T12:58:25.537425+0000","last_became_active":"2024-04-16T12:57:58.429051+0000","last_became_peered":"2024-04-16T12:57:58.429051+0000","last_unstale":"2024-04-16T12:58:25.537425+0000","last_undegraded":"2024-04-16T12:58:25.537425+0000","last_fullsized":"2024-04-16T12:58:25.537425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:25.537338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:25.537338+0000","last_clean_scrub_stamp":"2024-04-16T12:58:25.537338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:24.007656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:14.496290+0000","last_change":"2024-04-16T12:58:14.496311+0000","last_active":"2024-04-16T12:58:14.496290+0000","last_peered":"2024-04-16T12:58:14.496290+0000","last_clean":"2024-04-16T12:58:14.496290+0000","last_became_active":"2024-04-16T12:57:57.416985+0000","last_became_peered":"2024-04-16T12:57:57.416985+0000","last_unstale":"2024-04-16T12:58:14.496290+0000","last_undegraded":"2024-04-16T12:58:14.496290+0000","last_fullsized":"2024-04-16T12:58:14.496290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:14.496220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:14.496220+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.496220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:58.872283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:19.691522+0000","last_change":"2024-04-16T12:58:19.691587+0000","last_active":"2024-04-16T12:58:19.691522+0000","last_peered":"2024-04-16T12:58:19.691522+0000","last_clean":"2024-04-16T12:58:19.691522+0000","last_became_active":"2024-04-16T12:57:58.428052+0000","last_became_peered":"2024-04-16T12:57:58.428052+0000","last_unstale":"2024-04-16T12:58:19.691522+0000","last_undegraded":"2024-04-16T12:58:19.691522+0000","last_fullsized":"2024-04-16T12:58:19.691522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:19.691418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:19.691418+0000","last_clean_scrub_stamp":"2024-04-16T12:58:19.691418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:39.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.805551+0000","last_change":"2024-04-16T12:58:16.488202+0000","last_active":"2024-04-16T12:58:16.805551+0000","last_peered":"2024-04-16T12:58:16.805551+0000","last_clean":"2024-04-16T12:58:16.805551+0000","last_became_active":"2024-04-16T12:57:57.418340+0000","last_became_peered":"2024-04-16T12:57:57.418340+0000","last_unstale":"2024-04-16T12:58:16.805551+0000","last_undegraded":"2024-04-16T12:58:16.805551+0000","last_fullsized":"2024-04-16T12:58:16.805551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-16T12:58:16.488019+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-16T12:58:16.488019+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.488019+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:02:53.264587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:21.773044+0000","last_change":"2024-04-16T12:58:21.773086+0000","last_active":"2024-04-16T12:58:21.773044+0000","last_peered":"2024-04-16T12:58:21.773044+0000","last_clean":"2024-04-16T12:58:21.773044+0000","last_became_active":"2024-04-16T12:57:58.424617+0000","last_became_peered":"2024-04-16T12:57:58.424617+0000","last_unstale":"2024-04-16T12:58:21.773044+0000","last_undegraded":"2024-04-16T12:58:21.773044+0000","last_fullsized":"2024-04-16T12:58:21.773044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:21.772939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:21.772939+0000","last_clean_scrub_stamp":"2024-04-16T12:58:21.772939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:06.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.800611+0000","last_change":"2024-04-16T12:58:13.346764+0000","last_active":"2024-04-16T12:58:13.800611+0000","last_peered":"2024-04-16T12:58:13.800611+0000","last_clean":"2024-04-16T12:58:13.800611+0000","last_became_active":"2024-04-16T12:57:57.417225+0000","last_became_peered":"2024-04-16T12:57:57.417225+0000","last_unstale":"2024-04-16T12:58:13.800611+0000","last_undegraded":"2024-04-16T12:58:13.800611+0000","last_fullsized":"2024-04-16T12:58:13.800611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-04-16T12:58:13.346666+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-04-16T12:58:13.346666+0000","last_clean_scrub_stamp":"2024-04-16T12:58:13.346666+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:42:23.274033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:24.586292+0000","last_change":"2024-04-16T12:58:24.586319+0000","last_active":"2024-04-16T12:58:24.586292+0000","last_peered":"2024-04-16T12:58:24.586292+0000","last_clean":"2024-04-16T12:58:24.586292+0000","last_became_active":"2024-04-16T12:57:58.430969+0000","last_became_peered":"2024-04-16T12:57:58.430969+0000","last_unstale":"2024-04-16T12:58:24.586292+0000","last_undegraded":"2024-04-16T12:58:24.586292+0000","last_fullsized":"2024-04-16T12:58:24.586292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:24.586193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:24.586193+0000","last_clean_scrub_stamp":"2024-04-16T12:58:24.586193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:59.166015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.714185+0000","last_change":"2024-04-16T12:58:18.714217+0000","last_active":"2024-04-16T12:58:18.714185+0000","last_peered":"2024-04-16T12:58:18.714185+0000","last_clean":"2024-04-16T12:58:18.714185+0000","last_became_active":"2024-04-16T12:57:57.418699+0000","last_became_peered":"2024-04-16T12:57:57.418699+0000","last_unstale":"2024-04-16T12:58:18.714185+0000","last_undegraded":"2024-04-16T12:58:18.714185+0000","last_fullsized":"2024-04-16T12:58:18.714185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-16T12:58:18.714090+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-16T12:58:18.714090+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.714090+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:02:18.679576+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:22.251692+0000","last_change":"2024-04-16T12:58:22.251727+0000","last_active":"2024-04-16T12:58:22.251692+0000","last_peered":"2024-04-16T12:58:22.251692+0000","last_clean":"2024-04-16T12:58:22.251692+0000","last_became_active":"2024-04-16T12:57:58.430433+0000","last_became_peered":"2024-04-16T12:57:58.430433+0000","last_unstale":"2024-04-16T12:58:22.251692+0000","last_undegraded":"2024-04-16T12:58:22.251692+0000","last_fullsized":"2024-04-16T12:58:22.251692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:22.251578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:22.251578+0000","last_clean_scrub_stamp":"2024-04-16T12:58:22.251578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:25:21.762013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:15.692303+0000","last_change":"2024-04-16T12:58:15.692334+0000","last_active":"2024-04-16T12:58:15.692303+0000","last_peered":"2024-04-16T12:58:15.692303+0000","last_clean":"2024-04-16T12:58:15.692303+0000","last_became_active":"2024-04-16T12:57:57.418348+0000","last_became_peered":"2024-04-16T12:57:57.418348+0000","last_unstale":"2024-04-16T12:58:15.692303+0000","last_undegraded":"2024-04-16T12:58:15.692303+0000","last_fullsized":"2024-04-16T12:58:15.692303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-04-16T12:58:15.692206+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-04-16T12:58:15.692206+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.692206+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:35.375638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:15.359826+0000","last_change":"2024-04-16T12:58:15.359854+0000","last_active":"2024-04-16T12:58:15.359826+0000","last_peered":"2024-04-16T12:58:15.359826+0000","last_clean":"2024-04-16T12:58:15.359826+0000","last_became_active":"2024-04-16T12:57:58.420004+0000","last_became_peered":"2024-04-16T12:57:58.420004+0000","last_unstale":"2024-04-16T12:58:15.359826+0000","last_undegraded":"2024-04-16T12:58:15.359826+0000","last_fullsized":"2024-04-16T12:58:15.359826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:15.359731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:15.359731+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.359731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:08:44.260555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:19.753857+0000","last_change":"2024-04-16T12:58:19.753882+0000","last_active":"2024-04-16T12:58:19.753857+0000","last_peered":"2024-04-16T12:58:19.753857+0000","last_clean":"2024-04-16T12:58:19.753857+0000","last_became_active":"2024-04-16T12:57:57.419889+0000","last_became_peered":"2024-04-16T12:57:57.419889+0000","last_unstale":"2024-04-16T12:58:19.753857+0000","last_undegraded":"2024-04-16T12:58:19.753857+0000","last_fullsized":"2024-04-16T12:58:19.753857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:19.753768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:19.753768+0000","last_clean_scrub_stamp":"2024-04-16T12:58:19.753768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:53:03.104390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:20.400110+0000","last_change":"2024-04-16T12:58:20.400139+0000","last_active":"2024-04-16T12:58:20.400110+0000","last_peered":"2024-04-16T12:58:20.400110+0000","last_clean":"2024-04-16T12:58:20.400110+0000","last_became_active":"2024-04-16T12:57:58.427946+0000","last_became_peered":"2024-04-16T12:57:58.427946+0000","last_unstale":"2024-04-16T12:58:20.400110+0000","last_undegraded":"2024-04-16T12:58:20.400110+0000","last_fullsized":"2024-04-16T12:58:20.400110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:20.399999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:20.399999+0000","last_clean_scrub_stamp":"2024-04-16T12:58:20.399999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:49:38.522019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.800468+0000","last_change":"2024-04-16T12:58:13.727320+0000","last_active":"2024-04-16T12:58:13.800468+0000","last_peered":"2024-04-16T12:58:13.800468+0000","last_clean":"2024-04-16T12:58:13.800468+0000","last_became_active":"2024-04-16T12:57:57.416434+0000","last_became_peered":"2024-04-16T12:57:57.416434+0000","last_unstale":"2024-04-16T12:58:13.800468+0000","last_undegraded":"2024-04-16T12:58:13.800468+0000","last_fullsized":"2024-04-16T12:58:13.800468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-16T12:58:13.727212+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-16T12:58:13.727212+0000","last_clean_scrub_stamp":"2024-04-16T12:58:13.727212+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:10.991167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:14.349129+0000","last_change":"2024-04-16T12:58:14.349171+0000","last_active":"2024-04-16T12:58:14.349129+0000","last_peered":"2024-04-16T12:58:14.349129+0000","last_clean":"2024-04-16T12:58:14.349129+0000","last_became_active":"2024-04-16T12:57:58.414358+0000","last_became_peered":"2024-04-16T12:57:58.414358+0000","last_unstale":"2024-04-16T12:58:14.349129+0000","last_undegraded":"2024-04-16T12:58:14.349129+0000","last_fullsized":"2024-04-16T12:58:14.349129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:14.349025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:14.349025+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.349025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:27.219869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.806470+0000","last_change":"2024-04-16T12:58:13.668363+0000","last_active":"2024-04-16T12:58:13.806470+0000","last_peered":"2024-04-16T12:58:13.806470+0000","last_clean":"2024-04-16T12:58:13.806470+0000","last_became_active":"2024-04-16T12:57:57.417886+0000","last_became_peered":"2024-04-16T12:57:57.417886+0000","last_unstale":"2024-04-16T12:58:13.806470+0000","last_undegraded":"2024-04-16T12:58:13.806470+0000","last_fullsized":"2024-04-16T12:58:13.806470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:13.668237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:13.668237+0000","last_clean_scrub_stamp":"2024-04-16T12:58:13.668237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:35:18.535631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.320724+0000","last_change":"2024-04-16T12:58:16.320747+0000","last_active":"2024-04-16T12:58:16.320724+0000","last_peered":"2024-04-16T12:58:16.320724+0000","last_clean":"2024-04-16T12:58:16.320724+0000","last_became_active":"2024-04-16T12:57:58.421679+0000","last_became_peered":"2024-04-16T12:57:58.421679+0000","last_unstale":"2024-04-16T12:58:16.320724+0000","last_undegraded":"2024-04-16T12:58:16.320724+0000","last_fullsized":"2024-04-16T12:58:16.320724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:16.320633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:16.320633+0000","last_clean_scrub_stamp":"2024-04-16T12:58:16.320633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:52.527506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:20.790060+0000","last_change":"2024-04-16T12:58:20.790091+0000","last_active":"2024-04-16T12:58:20.790060+0000","last_peered":"2024-04-16T12:58:20.790060+0000","last_clean":"2024-04-16T12:58:20.790060+0000","last_became_active":"2024-04-16T12:57:57.420533+0000","last_became_peered":"2024-04-16T12:57:57.420533+0000","last_unstale":"2024-04-16T12:58:20.790060+0000","last_undegraded":"2024-04-16T12:58:20.790060+0000","last_fullsized":"2024-04-16T12:58:20.790060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:20.789964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:20.789964+0000","last_clean_scrub_stamp":"2024-04-16T12:58:20.789964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:52.295183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:15.461959+0000","last_change":"2024-04-16T12:58:15.461983+0000","last_active":"2024-04-16T12:58:15.461959+0000","last_peered":"2024-04-16T12:58:15.461959+0000","last_clean":"2024-04-16T12:58:15.461959+0000","last_became_active":"2024-04-16T12:57:58.417934+0000","last_became_peered":"2024-04-16T12:57:58.417934+0000","last_unstale":"2024-04-16T12:58:15.461959+0000","last_undegraded":"2024-04-16T12:58:15.461959+0000","last_fullsized":"2024-04-16T12:58:15.461959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:15.461845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:15.461845+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.461845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:47.994484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.795440+0000","last_change":"2024-04-16T12:58:13.504164+0000","last_active":"2024-04-16T12:58:13.795440+0000","last_peered":"2024-04-16T12:58:13.795440+0000","last_clean":"2024-04-16T12:58:13.795440+0000","last_became_active":"2024-04-16T12:57:57.415177+0000","last_became_peered":"2024-04-16T12:57:57.415177+0000","last_unstale":"2024-04-16T12:58:13.795440+0000","last_undegraded":"2024-04-16T12:58:13.795440+0000","last_fullsized":"2024-04-16T12:58:13.795440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:13.504044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:13.504044+0000","last_clean_scrub_stamp":"2024-04-16T12:58:13.504044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:02:13.469530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.374302+0000","last_change":"2024-04-16T12:58:18.374329+0000","last_active":"2024-04-16T12:58:18.374302+0000","last_peered":"2024-04-16T12:58:18.374302+0000","last_clean":"2024-04-16T12:58:18.374302+0000","last_became_active":"2024-04-16T12:57:58.424085+0000","last_became_peered":"2024-04-16T12:57:58.424085+0000","last_unstale":"2024-04-16T12:58:18.374302+0000","last_undegraded":"2024-04-16T12:58:18.374302+0000","last_fullsized":"2024-04-16T12:58:18.374302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:18.374139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:18.374139+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.374139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:24:23.192452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:16.804049+0000","last_change":"2024-04-16T12:58:15.366273+0000","last_active":"2024-04-16T12:58:16.804049+0000","last_peered":"2024-04-16T12:58:16.804049+0000","last_clean":"2024-04-16T12:58:16.804049+0000","last_became_active":"2024-04-16T12:57:57.419361+0000","last_became_peered":"2024-04-16T12:57:57.419361+0000","last_unstale":"2024-04-16T12:58:16.804049+0000","last_undegraded":"2024-04-16T12:58:16.804049+0000","last_fullsized":"2024-04-16T12:58:16.804049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-16T12:58:15.366087+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-16T12:58:15.366087+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.366087+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:02:15.331573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:21.546120+0000","last_change":"2024-04-16T12:58:21.546146+0000","last_active":"2024-04-16T12:58:21.546120+0000","last_peered":"2024-04-16T12:58:21.546120+0000","last_clean":"2024-04-16T12:58:21.546120+0000","last_became_active":"2024-04-16T12:57:58.426923+0000","last_became_peered":"2024-04-16T12:57:58.426923+0000","last_unstale":"2024-04-16T12:58:21.546120+0000","last_undegraded":"2024-04-16T12:58:21.546120+0000","last_fullsized":"2024-04-16T12:58:21.546120+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:21.545985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:21.545985+0000","last_clean_scrub_stamp":"2024-04-16T12:58:21.545985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:31:18.320374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.799812+0000","last_change":"2024-04-16T12:58:12.765366+0000","last_active":"2024-04-16T12:58:13.799812+0000","last_peered":"2024-04-16T12:58:13.799812+0000","last_clean":"2024-04-16T12:58:13.799812+0000","last_became_active":"2024-04-16T12:57:57.415700+0000","last_became_peered":"2024-04-16T12:57:57.415700+0000","last_unstale":"2024-04-16T12:58:13.799812+0000","last_undegraded":"2024-04-16T12:58:13.799812+0000","last_fullsized":"2024-04-16T12:58:13.799812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:12.765262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:12.765262+0000","last_clean_scrub_stamp":"2024-04-16T12:58:12.765262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:52.897033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:17.769898+0000","last_change":"2024-04-16T12:58:17.769934+0000","last_active":"2024-04-16T12:58:17.769898+0000","last_peered":"2024-04-16T12:58:17.769898+0000","last_clean":"2024-04-16T12:58:17.769898+0000","last_became_active":"2024-04-16T12:57:58.419394+0000","last_became_peered":"2024-04-16T12:57:58.419394+0000","last_unstale":"2024-04-16T12:58:17.769898+0000","last_undegraded":"2024-04-16T12:58:17.769898+0000","last_fullsized":"2024-04-16T12:58:17.769898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:17.769803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:17.769803+0000","last_clean_scrub_stamp":"2024-04-16T12:58:17.769803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:24.436542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.800060+0000","last_change":"2024-04-16T12:58:11.370711+0000","last_active":"2024-04-16T12:58:13.800060+0000","last_peered":"2024-04-16T12:58:13.800060+0000","last_clean":"2024-04-16T12:58:13.800060+0000","last_became_active":"2024-04-16T12:57:57.415564+0000","last_became_peered":"2024-04-16T12:57:57.415564+0000","last_unstale":"2024-04-16T12:58:13.800060+0000","last_undegraded":"2024-04-16T12:58:13.800060+0000","last_fullsized":"2024-04-16T12:58:13.800060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:11.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:11.370606+0000","last_clean_scrub_stamp":"2024-04-16T12:58:11.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:10:10.002481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:18.666670+0000","last_change":"2024-04-16T12:58:18.666734+0000","last_active":"2024-04-16T12:58:18.666670+0000","last_peered":"2024-04-16T12:58:18.666670+0000","last_clean":"2024-04-16T12:58:18.666670+0000","last_became_active":"2024-04-16T12:57:58.420421+0000","last_became_peered":"2024-04-16T12:57:58.420421+0000","last_unstale":"2024-04-16T12:58:18.666670+0000","last_undegraded":"2024-04-16T12:58:18.666670+0000","last_fullsized":"2024-04-16T12:58:18.666670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:18.666555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:18.666555+0000","last_clean_scrub_stamp":"2024-04-16T12:58:18.666555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:10:17.298430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.800283+0000","last_change":"2024-04-16T12:58:11.753031+0000","last_active":"2024-04-16T12:58:13.800283+0000","last_peered":"2024-04-16T12:58:13.800283+0000","last_clean":"2024-04-16T12:58:13.800283+0000","last_became_active":"2024-04-16T12:57:57.413425+0000","last_became_peered":"2024-04-16T12:57:57.413425+0000","last_unstale":"2024-04-16T12:58:13.800283+0000","last_undegraded":"2024-04-16T12:58:13.800283+0000","last_fullsized":"2024-04-16T12:58:13.800283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:11.752924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:11.752924+0000","last_clean_scrub_stamp":"2024-04-16T12:58:11.752924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:15.148597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:15.782654+0000","last_change":"2024-04-16T12:58:15.782677+0000","last_active":"2024-04-16T12:58:15.782654+0000","last_peered":"2024-04-16T12:58:15.782654+0000","last_clean":"2024-04-16T12:58:15.782654+0000","last_became_active":"2024-04-16T12:57:58.417552+0000","last_became_peered":"2024-04-16T12:57:58.417552+0000","last_unstale":"2024-04-16T12:58:15.782654+0000","last_undegraded":"2024-04-16T12:58:15.782654+0000","last_fullsized":"2024-04-16T12:58:15.782654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:15.782517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:15.782517+0000","last_clean_scrub_stamp":"2024-04-16T12:58:15.782517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:18.813922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:14.350482+0000","last_change":"2024-04-16T12:58:14.350523+0000","last_active":"2024-04-16T12:58:14.350482+0000","last_peered":"2024-04-16T12:58:14.350482+0000","last_clean":"2024-04-16T12:58:14.350482+0000","last_became_active":"2024-04-16T12:57:57.418028+0000","last_became_peered":"2024-04-16T12:57:57.418028+0000","last_unstale":"2024-04-16T12:58:14.350482+0000","last_undegraded":"2024-04-16T12:58:14.350482+0000","last_fullsized":"2024-04-16T12:58:14.350482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:14.350391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:14.350391+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.350391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:41.142401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:22.483015+0000","last_change":"2024-04-16T12:58:22.483036+0000","last_active":"2024-04-16T12:58:22.483015+0000","last_peered":"2024-04-16T12:58:22.483015+0000","last_clean":"2024-04-16T12:58:22.483015+0000","last_became_active":"2024-04-16T12:57:58.415087+0000","last_became_peered":"2024-04-16T12:57:58.415087+0000","last_unstale":"2024-04-16T12:58:22.483015+0000","last_undegraded":"2024-04-16T12:58:22.483015+0000","last_fullsized":"2024-04-16T12:58:22.483015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:22.482927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:22.482927+0000","last_clean_scrub_stamp":"2024-04-16T12:58:22.482927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:36:30.880591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.799576+0000","last_change":"2024-04-16T12:58:12.695707+0000","last_active":"2024-04-16T12:58:13.799576+0000","last_peered":"2024-04-16T12:58:13.799576+0000","last_clean":"2024-04-16T12:58:13.799576+0000","last_became_active":"2024-04-16T12:57:57.424266+0000","last_became_peered":"2024-04-16T12:57:57.424266+0000","last_unstale":"2024-04-16T12:58:13.799576+0000","last_undegraded":"2024-04-16T12:58:13.799576+0000","last_fullsized":"2024-04-16T12:58:13.799576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:12.695579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:12.695579+0000","last_clean_scrub_stamp":"2024-04-16T12:58:12.695579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:09.959533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:25.725162+0000","last_change":"2024-04-16T12:58:25.725201+0000","last_active":"2024-04-16T12:58:25.725162+0000","last_peered":"2024-04-16T12:58:25.725162+0000","last_clean":"2024-04-16T12:58:25.725162+0000","last_became_active":"2024-04-16T12:57:58.427855+0000","last_became_peered":"2024-04-16T12:57:58.427855+0000","last_unstale":"2024-04-16T12:58:25.725162+0000","last_undegraded":"2024-04-16T12:58:25.725162+0000","last_fullsized":"2024-04-16T12:58:25.725162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:25.725056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:25.725056+0000","last_clean_scrub_stamp":"2024-04-16T12:58:25.725056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:44:19.062064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:13.802935+0000","last_change":"2024-04-16T12:58:13.509702+0000","last_active":"2024-04-16T12:58:13.802935+0000","last_peered":"2024-04-16T12:58:13.802935+0000","last_clean":"2024-04-16T12:58:13.802935+0000","last_became_active":"2024-04-16T12:57:57.416272+0000","last_became_peered":"2024-04-16T12:57:57.416272+0000","last_unstale":"2024-04-16T12:58:13.802935+0000","last_undegraded":"2024-04-16T12:58:13.802935+0000","last_fullsized":"2024-04-16T12:58:13.802935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:13.509605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:13.509605+0000","last_clean_scrub_stamp":"2024-04-16T12:58:13.509605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:27:37.189928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:22.502943+0000","last_change":"2024-04-16T12:58:22.502970+0000","last_active":"2024-04-16T12:58:22.502943+0000","last_peered":"2024-04-16T12:58:22.502943+0000","last_clean":"2024-04-16T12:58:22.502943+0000","last_became_active":"2024-04-16T12:57:58.422565+0000","last_became_peered":"2024-04-16T12:57:58.422565+0000","last_unstale":"2024-04-16T12:58:22.502943+0000","last_undegraded":"2024-04-16T12:58:22.502943+0000","last_fullsized":"2024-04-16T12:58:22.502943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:22.502819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:22.502819+0000","last_clean_scrub_stamp":"2024-04-16T12:58:22.502819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:44:15.839828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:14.706319+0000","last_change":"2024-04-16T12:58:14.706343+0000","last_active":"2024-04-16T12:58:14.706319+0000","last_peered":"2024-04-16T12:58:14.706319+0000","last_clean":"2024-04-16T12:58:14.706319+0000","last_became_active":"2024-04-16T12:57:57.418138+0000","last_became_peered":"2024-04-16T12:57:57.418138+0000","last_unstale":"2024-04-16T12:58:14.706319+0000","last_undegraded":"2024-04-16T12:58:14.706319+0000","last_fullsized":"2024-04-16T12:58:14.706319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:58:14.706215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:58:14.706215+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.706215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:50.913088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-16T12:58:14.480202+0000","last_change":"2024-04-16T12:58:14.480241+0000","last_active":"2024-04-16T12:58:14.480202+0000","last_peered":"2024-04-16T12:58:14.480202+0000","last_clean":"2024-04-16T12:58:14.480202+0000","last_became_active":"2024-04-16T12:57:07.323524+0000","last_became_peered":"2024-04-16T12:57:07.323524+0000","last_unstale":"2024-04-16T12:58:14.480202+0000","last_undegraded":"2024-04-16T12:58:14.480202+0000","last_fullsized":"2024-04-16T12:58:14.480202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-04-16T12:58:14.480100+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-04-16T12:58:14.480100+0000","last_clean_scrub_stamp":"2024-04-16T12:58:14.480100+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:46:05.239010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":720551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":130709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":130765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":130197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":131727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":130163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":131727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":929792,"data_stored":720461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:58:34.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-16T12:58:34.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.566+0000 7f6293693640 1 Processor -- start 2024-04-16T12:58:34.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6293693640 1 -- start start 2024-04-16T12:58:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6293693640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f628c148c30 0x7f628c09eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6293693640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c14c030 con 0x7f628c09cb60 2024-04-16T12:58:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6293693640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c14c310 con 0x7f628c14b6d0 2024-04-16T12:58:34.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6293693640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f628c148090 con 0x7f628c148c30 2024-04-16T12:58:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6290c2e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f628c148c30 0x7f628c09eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6291c30640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f628c09cb60 0x7f628c152790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51804/0 (socket says 172.21.15.106:51804) 2024-04-16T12:58:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.567+0000 7f6291c30640 1 -- 172.21.15.106:0/3159327122 learned_addr learned my addr 172.21.15.106:0/3159327122 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-16T12:58:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.568+0000 7f6290c2e640 1 -- 172.21.15.106:0/3159327122 >> v1:172.21.15.171:6789/0 conn(0x7f628c14b6d0 legacy=0x7f628c148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.568+0000 7f6290c2e640 1 -- 172.21.15.106:0/3159327122 >> v1:172.21.15.106:6789/0 conn(0x7f628c09cb60 legacy=0x7f628c152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.568+0000 7f628bfff640 1 -- 172.21.15.106:0/3159327122 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433538909 0 0) 0x7f628c14c030 con 0x7f628c09cb60 2024-04-16T12:58:34.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.568+0000 7f6290c2e640 1 -- 172.21.15.106:0/3159327122 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c09b310 con 0x7f628c148c30 2024-04-16T12:58:34.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.568+0000 7f6290c2e640 1 --2- 172.21.15.106:0/3159327122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c148c30 0x7f628c09eeb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f62800097a0 tx=0x7f628002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f37641dde3eac58 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.568+0000 7f628bfff640 1 -- 172.21.15.106:0/3159327122 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280038070 con 0x7f628c148c30 2024-04-16T12:58:34.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f628bfff640 1 -- 172.21.15.106:0/3159327122 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6280031700 con 0x7f628c148c30 2024-04-16T12:58:34.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f628bfff640 1 -- 172.21.15.106:0/3159327122 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280031ad0 con 0x7f628c148c30 2024-04-16T12:58:34.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f6293693640 1 -- 172.21.15.106:0/3159327122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c148c30 msgr2=0x7f628c09eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f6293693640 1 --2- 172.21.15.106:0/3159327122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c148c30 0x7f628c09eeb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f62800097a0 tx=0x7f628002b7a0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f6293693640 1 -- 172.21.15.106:0/3159327122 shutdown_connections 2024-04-16T12:58:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f6293693640 1 --2- 172.21.15.106:0/3159327122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c148c30 0x7f628c09eeb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f6293693640 1 -- 172.21.15.106:0/3159327122 >> 172.21.15.106:0/3159327122 conn(0x7f628c0ba080 msgr2=0x7f628c0ba490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f6293693640 1 -- 172.21.15.106:0/3159327122 shutdown_connections 2024-04-16T12:58:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.569+0000 7f6293693640 1 -- 172.21.15.106:0/3159327122 wait complete. 2024-04-16T12:58:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.570+0000 7f6293693640 1 Processor -- start 2024-04-16T12:58:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.570+0000 7f6293693640 1 -- start start 2024-04-16T12:58:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6293693640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f628c09cb60 0x7f628c0b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6293693640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f628c148c30 0x7f628c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6293693640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c14b6d0 0x7f628c1e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6293693640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f628c09d470 con 0x7f628c14b6d0 2024-04-16T12:58:34.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6293693640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f628c14bd80 con 0x7f628c148c30 2024-04-16T12:58:34.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6293693640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f628c09f3f0 con 0x7f628c09cb60 2024-04-16T12:58:34.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c14b6d0 0x7f628c1e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c14b6d0 0x7f628c1e0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55854/0 (socket says 172.21.15.106:55854) 2024-04-16T12:58:34.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 -- 172.21.15.106:0/3969906776 learned_addr learned my addr 172.21.15.106:0/3969906776 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6290c2e640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f628c148c30 0x7f628c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f629142f640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f628c09cb60 0x7f628c0b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 -- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f628c09cb60 msgr2=0x7f628c0b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f628c09cb60 0x7f628c0b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 -- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f628c148c30 msgr2=0x7f628c0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f628c148c30 0x7f628c0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 -- 172.21.15.106:0/3969906776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c0b2210 con 0x7f628c14b6d0 2024-04-16T12:58:34.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.571+0000 7f6291c30640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c14b6d0 0x7f628c1e0ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f627c00c4b0 tx=0x7f627c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.572+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c005ce0 con 0x7f628c14b6d0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.572+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c007070 con 0x7f628c14b6d0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.572+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c0b24f0 con 0x7f628c14b6d0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.572+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c0074a0 con 0x7f628c14b6d0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.572+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c0a3000 con 0x7f628c14b6d0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.573+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628c068a90 con 0x7f628c14b6d0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.573+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f627c01b400 con 0x7f628c14b6d0 2024-04-16T12:58:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.574+0000 7f6289ffb640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f627806c8f0 0x7f627806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.574+0000 7f629142f640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f627806c8f0 0x7f627806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.574+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5795+0+0 (secure 0 0 0) 0x7f627c08b5c0 con 0x7f628c14b6d0 2024-04-16T12:58:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.574+0000 7f629142f640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f627806c8f0 0x7f627806edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f628400b450 tx=0x7f628400d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.578+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f627c0593d0 con 0x7f628c14b6d0 2024-04-16T12:58:34.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.752+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f628c0b2a90 con 0x7f628c14b6d0 2024-04-16T12:58:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.756+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7f627c05d6d0 con 0x7f628c14b6d0 2024-04-16T12:58:34.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.756+0000 7f6289ffb640 1 -- 172.21.15.106:0/3969906776 <== mon.0 v2:172.21.15.106:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f627c007e40 con 0x7f628c14b6d0 2024-04-16T12:58:34.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f627806c8f0 msgr2=0x7f627806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f627806c8f0 0x7f627806edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f628400b450 tx=0x7f628400d040 comp rx=0 tx=0).stop 2024-04-16T12:58:34.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c14b6d0 msgr2=0x7f628c1e0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c14b6d0 0x7f628c1e0ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f627c00c4b0 tx=0x7f627c00c970 comp rx=0 tx=0).stop 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 shutdown_connections 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7f627806c8f0 0x7f627806edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f628c14b6d0 0x7f628c1e0ba0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f628c148c30 0x7f628c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 --2- 172.21.15.106:0/3969906776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f628c09cb60 0x7f628c0b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 >> 172.21.15.106:0/3969906776 conn(0x7f628c0ba080 msgr2=0x7f628c0b8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 shutdown_connections 2024-04-16T12:58:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.758+0000 7f6293693640 1 -- 172.21.15.106:0/3969906776 wait complete. 2024-04-16T12:58:34.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~32s 2024-04-16T12:58:34.771 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T12:58:34.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:58:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.872+0000 7fdb94d50640 1 Processor -- start 2024-04-16T12:58:34.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.872+0000 7fdb94d50640 1 -- start start 2024-04-16T12:58:34.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb94d50640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb9006c6b0 0x7fdb901493a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb94d50640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdb901498e0 0x7fdb90149d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb94d50640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9009e0b0 con 0x7fdb9006bc20 2024-04-16T12:58:34.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb94d50640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fdb9009e320 con 0x7fdb9006c6b0 2024-04-16T12:58:34.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb94d50640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdb9006c000 con 0x7fdb901498e0 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb8dd9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb9006c6b0 0x7fdb901493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb8dd9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb9006c6b0 0x7fdb901493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55866/0 (socket says 172.21.15.106:55866) 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/4197452347 learned_addr learned my addr 172.21.15.106:0/4197452347 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.873+0000 7fdb8ed9d640 1 --2- 172.21.15.106:0/4197452347 >> v2:172.21.15.171:3300/0 conn(0x7fdb901498e0 0x7fdb90149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.874+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/4197452347 >> v2:172.21.15.171:3300/0 conn(0x7fdb901498e0 msgr2=0x7fdb90149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.874+0000 7fdb8dd9b640 1 --2- 172.21.15.106:0/4197452347 >> v2:172.21.15.171:3300/0 conn(0x7fdb901498e0 0x7fdb90149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.874+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/4197452347 >> v1:172.21.15.171:6789/0 conn(0x7fdb9006bc20 legacy=0x7fdb900b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:58:34.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.874+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/4197452347 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb900b5160 con 0x7fdb9006c6b0 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.874+0000 7fdb8ed9d640 1 --2- 172.21.15.106:0/4197452347 >> v2:172.21.15.171:3300/0 conn(0x7fdb901498e0 0x7fdb90149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.874+0000 7fdb8dd9b640 1 --2- 172.21.15.106:0/4197452347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb901493a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009870 tx=0x7fdb7802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b52d7564a302f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.874+0000 7fdb8d59a640 1 -- 172.21.15.106:0/4197452347 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7802e070 con 0x7fdb9006c6b0 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb8d59a640 1 -- 172.21.15.106:0/4197452347 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdb78037070 con 0x7fdb9006c6b0 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb8d59a640 1 -- 172.21.15.106:0/4197452347 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78031a20 con 0x7fdb9006c6b0 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 -- 172.21.15.106:0/4197452347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 msgr2=0x7fdb901493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 --2- 172.21.15.106:0/4197452347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb901493a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009870 tx=0x7fdb7802b880 comp rx=0 tx=0).stop 2024-04-16T12:58:34.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 -- 172.21.15.106:0/4197452347 shutdown_connections 2024-04-16T12:58:34.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 --2- 172.21.15.106:0/4197452347 >> v2:172.21.15.171:3300/0 conn(0x7fdb901498e0 0x7fdb90149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 --2- 172.21.15.106:0/4197452347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb901493a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 -- 172.21.15.106:0/4197452347 >> 172.21.15.106:0/4197452347 conn(0x7fdb900ba550 msgr2=0x7fdb900ba930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:34.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 -- 172.21.15.106:0/4197452347 shutdown_connections 2024-04-16T12:58:34.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.875+0000 7fdb94d50640 1 -- 172.21.15.106:0/4197452347 wait complete. 2024-04-16T12:58:34.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.876+0000 7fdb94d50640 1 Processor -- start 2024-04-16T12:58:34.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.876+0000 7fdb94d50640 1 -- start start 2024-04-16T12:58:34.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb94d50640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb9006bc20 0x7fdb900af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb94d50640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb90142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb94d50640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb901498e0 0x7fdb90142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb94d50640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdb900b60d0 con 0x7fdb9006c6b0 2024-04-16T12:58:34.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb94d50640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdb900b5c70 con 0x7fdb901498e0 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb94d50640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9009f8d0 con 0x7fdb9006bc20 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb90142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb90142040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55874/0 (socket says 172.21.15.106:55874) 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/1640669262 learned_addr learned my addr 172.21.15.106:0/1640669262 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8e59c640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb9006bc20 0x7fdb900af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8ed9d640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb901498e0 0x7fdb90142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb9006bc20 msgr2=0x7fdb900af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb9006bc20 0x7fdb900af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb901498e0 msgr2=0x7fdb90142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb901498e0 0x7fdb90142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 -- 172.21.15.106:0/1640669262 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb901cf7d0 con 0x7fdb9006c6b0 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.877+0000 7fdb8dd9b640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb90142040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdb78000c00 tx=0x7fdb780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.878+0000 7fdb86ffd640 1 -- 172.21.15.106:0/1640669262 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78032940 con 0x7fdb9006c6b0 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.878+0000 7fdb86ffd640 1 -- 172.21.15.106:0/1640669262 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdb78032b00 con 0x7fdb9006c6b0 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.878+0000 7fdb86ffd640 1 -- 172.21.15.106:0/1640669262 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb780453f0 con 0x7fdb9006c6b0 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.878+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb901cfd20 con 0x7fdb9006c6b0 2024-04-16T12:58:34.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.878+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb901cfa40 con 0x7fdb9006c6b0 2024-04-16T12:58:34.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.879+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb900b13d0 con 0x7fdb9006c6b0 2024-04-16T12:58:34.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.879+0000 7fdb86ffd640 1 -- 172.21.15.106:0/1640669262 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb7804c060 con 0x7fdb9006c6b0 2024-04-16T12:58:34.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.879+0000 7fdb86ffd640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb7006c8f0 0x7fdb7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:58:34.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.880+0000 7fdb86ffd640 1 -- 172.21.15.106:0/1640669262 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5795+0+0 (secure 0 0 0) 0x7fdb780ad400 con 0x7fdb9006c6b0 2024-04-16T12:58:34.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.880+0000 7fdb8e59c640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb7006c8f0 0x7fdb7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:58:34.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.880+0000 7fdb8e59c640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb7006c8f0 0x7fdb7006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb900b0f30 tx=0x7fdb88009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:58:34.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:34.884+0000 7fdb86ffd640 1 -- 172.21.15.106:0/1640669262 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb900b13d0 con 0x7fdb9006c6b0 2024-04-16T12:58:35.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.095+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb900691a0 con 0x7fdb9006c6b0 2024-04-16T12:58:35.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.095+0000 7fdb86ffd640 1 -- 172.21.15.106:0/1640669262 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+2711 (secure 0 0 0) 0x7fdb901cfd20 con 0x7fdb9006c6b0 2024-04-16T12:58:35.097 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-16T12:58:35.098 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:57:57.765565+0000","modified":"2024-04-16T12:58:16.793557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4661":{"gid":4661,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":9,"addr":"172.21.15.171:6833/2467066081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2467066081},{"type":"v1","addr":"172.21.15.171:6833","nonce":2467066081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4661,"qdb_cluster":[4661]},"id":2}]} 2024-04-16T12:58:35.098 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2024-04-16T12:58:35.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb7006c8f0 msgr2=0x7fdb7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:35.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb7006c8f0 0x7fdb7006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb900b0f30 tx=0x7fdb88009040 comp rx=0 tx=0).stop 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 msgr2=0x7fdb90142040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb90142040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdb78000c00 tx=0x7fdb780046c0 comp rx=0 tx=0).stop 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 shutdown_connections 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:6832/3856209158,v1:172.21.15.106:6833/3856209158] conn(0x7fdb7006c8f0 0x7fdb7006edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb901498e0 0x7fdb90142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb9006c6b0 0x7fdb90142040 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 --2- 172.21.15.106:0/1640669262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb9006bc20 0x7fdb900af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 >> 172.21.15.106:0/1640669262 conn(0x7fdb900ba550 msgr2=0x7fdb900726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:58:35.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.097+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 shutdown_connections 2024-04-16T12:58:35.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-16T12:58:35.098+0000 7fdb94d50640 1 -- 172.21.15.106:0/1640669262 wait complete. 2024-04-16T12:58:35.110 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-16T12:58:35.110 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T12:58:35.110 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T12:58:35.110 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:58:35.111 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T12:58:35.128 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T12:58:35.128 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T12:58:35.128 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.141 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T12:58:35.141 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T12:58:35.141 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-16T12:58:35.141 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.179 INFO:tasks.ceph.osd.0:Stopped 2024-04-16T12:58:35.179 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-16T12:58:35.179 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.249 INFO:tasks.ceph.osd.1:Stopped 2024-04-16T12:58:35.249 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-16T12:58:35.249 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.312 INFO:tasks.ceph.osd.2:Stopped 2024-04-16T12:58:35.313 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-16T12:58:35.313 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.383 INFO:tasks.ceph.osd.3:Stopped 2024-04-16T12:58:35.383 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-16T12:58:35.383 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.420 INFO:tasks.ceph.osd.4:Stopped 2024-04-16T12:58:35.421 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-16T12:58:35.421 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.489 INFO:tasks.ceph.osd.5:Stopped 2024-04-16T12:58:35.489 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-16T12:58:35.489 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.561 INFO:tasks.ceph.osd.6:Stopped 2024-04-16T12:58:35.561 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-16T12:58:35.562 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.632 INFO:tasks.ceph.osd.7:Stopped 2024-04-16T12:58:35.632 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T12:58:35.632 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-16T12:58:35.632 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.659 INFO:tasks.ceph.mgr.y:Stopped 2024-04-16T12:58:35.659 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-16T12:58:35.659 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.701 INFO:tasks.ceph.mgr.x:Stopped 2024-04-16T12:58:35.702 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T12:58:35.702 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-16T12:58:35.702 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.712 INFO:tasks.ceph.mon.a:Stopped 2024-04-16T12:58:35.713 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-16T12:58:35.713 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.754 INFO:tasks.ceph.mon.b:Stopped 2024-04-16T12:58:35.755 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-16T12:58:35.755 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:58:35.807 INFO:tasks.ceph.mon.c:Stopped 2024-04-16T12:58:35.808 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T12:58:35.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-16T12:58:35.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:58:35.844 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-16T12:58:36.045 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:58:36.045 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-16T12:58:36.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:58:36.159 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-16T12:58:36.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:58:36.226 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-16T12:58:36.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:58:36.284 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-16T12:58:36.432 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:58:36.432 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-16T12:58:36.496 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:58:36.497 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-16T12:58:36.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:58:36.545 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-16T12:58:36.594 INFO:tasks.ceph:Archiving mon data... 2024-04-16T12:58:36.595 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/data/mon.a.tgz 2024-04-16T12:58:36.596 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-16T12:58:36.611 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.MCz8EK8xFs 2024-04-16T12:58:36.612 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MCz8EK8xFs 2024-04-16T12:58:36.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.MCz8EK8xFs 2024-04-16T12:58:36.826 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.MCz8EK8xFs is 265KB 2024-04-16T12:58:36.922 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.MCz8EK8xFs 2024-04-16T12:58:36.938 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/data/mon.b.tgz 2024-04-16T12:58:36.938 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-16T12:58:36.956 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.9kfU7JXqeO 2024-04-16T12:58:36.956 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9kfU7JXqeO 2024-04-16T12:58:37.135 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.9kfU7JXqeO 2024-04-16T12:58:37.224 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.9kfU7JXqeO is 361KB 2024-04-16T12:58:37.319 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.9kfU7JXqeO 2024-04-16T12:58:37.334 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/data/mon.c.tgz 2024-04-16T12:58:37.334 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-16T12:58:37.392 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.tHnZvgStrs 2024-04-16T12:58:37.392 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tHnZvgStrs 2024-04-16T12:58:37.524 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.tHnZvgStrs 2024-04-16T12:58:37.609 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.tHnZvgStrs is 361KB 2024-04-16T12:58:37.705 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.tHnZvgStrs 2024-04-16T12:58:37.720 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T12:58:37.720 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T12:58:37.722 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T12:58:37.807 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T12:58:37.843 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T12:58:37.843 INFO:tasks.ceph:Archiving crash dumps... 2024-04-16T12:58:37.845 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/remote/smithi106/crash 2024-04-16T12:58:37.845 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T12:58:37.885 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/remote/smithi171/crash 2024-04-16T12:58:37.886 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T12:58:37.913 INFO:tasks.ceph:Shutting down logrotate 2024-04-16T12:58:37.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:58:37.923 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:58:38.014 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T12:58:38.044 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T12:58:38.072 INFO:tasks.ceph:Compressing logs... 2024-04-16T12:58:38.072 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T12:58:38.087 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T12:58:38.162 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-16T12:58:38.162 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37165.log 2024-04-16T12:58:38.163 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37325.log 2024-04-16T12:58:38.163 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.37165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37445.log 2024-04-16T12:58:38.163 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37325.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37165.log.gz 2024-04-16T12:58:38.163 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T12:58:38.163 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37325.log.gz 2024-04-16T12:58:38.163 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37445.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-16T12:58:38.163 INFO:teuthology.orchestra.run.smithi171.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37445.log.gz 2024-04-16T12:58:38.164 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37205.log 2024-04-16T12:58:38.164 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37405.log 2024-04-16T12:58:38.164 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37205.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-16T12:58:38.164 INFO:teuthology.orchestra.run.smithi171.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37205.log.gz 2024-04-16T12:58:38.164 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5/var/log/ceph/ceph-client.admin.37405.log: --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-16T12:58:38.164 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-16T12:58:38.164 INFO:teuthology.orchestra.run.smithi171.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37405.log.gz 2024-04-16T12:58:38.165 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T12:58:38.165 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37285.log 2024-04-16T12:58:38.165 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-16T12:58:38.165 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-04-16T12:58:38.165 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3%/var/log/ceph/ceph-mgr.x.log: -- replaced with /var/log/ceph/ceph-client.admin.37285.log.gz 2024-04-16T12:58:38.165 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T12:58:38.165 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37245.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-16T12:58:38.166 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2024-04-16T12:58:38.166 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-16T12:58:38.166 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37365.log 2024-04-16T12:58:38.166 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-16T12:58:38.166 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T12:58:38.166 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37365.log: /var/log/ceph/ceph-mon.c.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37365.log.gz 2024-04-16T12:58:38.166 INFO:teuthology.orchestra.run.smithi171.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-16T12:58:38.197 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31340.log 2024-04-16T12:58:38.197 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-16T12:58:38.197 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.tmp-client.admin.31340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50244.log 2024-04-16T12:58:38.197 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31340.log.gz 2024-04-16T12:58:38.197 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49020.log 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49188.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50244.log.gz 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50386.log 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44740.log 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49020.log.gz 2024-04-16T12:58:38.198 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46878.log 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50386.log.gz 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44740.log.gz 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45034.log 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45034.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-04-16T12:58:38.199 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45882.log 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45034.log.gz 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.45882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.0.45882.log.gz 2024-04-16T12:58:38.200 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43690.log 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47781.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43606.log 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43690.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49560.log 2024-04-16T12:58:38.201 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43690.log.gz 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48373.log 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43606.log.gz 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42795.log 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44208.log 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48373.log.gz 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48764.log 2024-04-16T12:58:38.202 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44208.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42795.log.gz 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47099.log 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48764.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44208.log.gz 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46584.log 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48764.log.gz 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48806.log 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47099.log.gz 2024-04-16T12:58:38.203 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46584.log.gz 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47613.log 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49655.log 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47613.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48806.log.gz -- 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr: /var/log/ceph/ceph-client.admin.48081.log 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47613.log.gz 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43438.log 2024-04-16T12:58:38.204 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49655.log.gz 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45160.log 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43438.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45160.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43438.log.gz 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49824.log 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45160.log.gz 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-04-16T12:58:38.205 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47409.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49824.log.gz 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47241.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48541.log 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43864.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2024-04-16T12:58:38.206 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46668.log 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48205.log 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48541.log.gz 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48669.log 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48205.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46668.log.gz 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46374.log 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48205.log.gz 2024-04-16T12:58:38.207 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48669.log.gz 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46920.log 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47739.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46374.log.gz 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44205.log 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46920.log.gz/var/log/ceph/ceph-client.admin.46248.log: 2024-04-16T12:58:38.208 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48583.log 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44205.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44205.log.gz 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48583.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45370.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48583.log.gzgzip 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46710.log 2024-04-16T12:58:38.209 INFO:teuthology.orchestra.run.smithi106.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49992.log 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50346.log 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46710.log: /var/log/ceph/ceph-client.admin.49992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46710.log.gz 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50346.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49992.log.gz 2024-04-16T12:58:38.210 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43648.log 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50346.log.gz 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43109.log 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42857.log 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43648.log.gz 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43109.log.gz 2024-04-16T12:58:38.211 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43872.log 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42857.log.gz 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43522.log 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47907.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43872.log.gz 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-04-16T12:58:38.212 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45286.log 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43522.log.gz 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45286.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44908.log 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48894.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45286.log.gz 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45202.log 2024-04-16T12:58:38.213 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46752.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44908.log.gz 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44404.log 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45202.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45202.log.gz 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43197.log 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46416.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44404.log.gz 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-16T12:58:38.214 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43197.log.gz 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49314.log 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50428.log 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44824.log 2024-04-16T12:58:38.215 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49314.log: /var/log/ceph/ceph-client.admin.50428.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49314.log.gz 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.50428.log.gz -5 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44824.log: /var/log/ceph/ceph-client.admin.50286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44824.log.gz 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47967.log 2024-04-16T12:58:38.216 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46794.log: /var/log/ceph/ceph-client.admin.43308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50202.log 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47967.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44195.log 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47967.log.gz 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44195.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50202.log.gz 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43868.log 2024-04-16T12:58:38.217 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44195.log.gz 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43067.log 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43868.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43868.log.gz 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43067.log: /var/log/ceph/ceph-client.admin.50076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48331.log 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43067.log.gz 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47141.log: gzip 87.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz -- 2024-04-16T12:58:38.218 INFO:teuthology.orchestra.run.smithi106.stderr: /var/log/ceph/ceph-client.admin.47655.log 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48331.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48331.log.gz 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45076.log 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47655.log.gz 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44539.log 2024-04-16T12:58:38.219 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45076.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44539.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45076.log.gz 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44542.log 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49104.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44539.log.gz 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48457.log 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2024-04-16T12:58:38.220 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48457.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44542.log.gz 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48247.log 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48457.log.gz 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48247.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48247.log.gz 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44544.log 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46500.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2024-04-16T12:58:38.221 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50118.log 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48936.log 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44544.log.gz 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44203.log 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47367.log 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50118.log.gz 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48936.log: /var/log/ceph/ceph-client.admin.44203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48029.log 2024-04-16T12:58:38.222 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48936.log.gz 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44203.log.gz 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44543.log 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48029.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44950.log 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48029.log.gz 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44543.log.gz 2024-04-16T12:58:38.223 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46206.log: /var/log/ceph/ceph-client.admin.44950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43865.log 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz/var/log/ceph/ceph-client.admin.43866.log: gzip 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43869.log 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43865.log.gz 2024-04-16T12:58:38.224 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49613.log 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43869.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43153.log 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43869.log.gz 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49613.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43153.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49613.log.gz 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48625.log 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2024-04-16T12:58:38.225 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48978.log 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45244.log 88.7% 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48625.log.gz 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49062.log 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48978.log.gz 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44536.log 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49062.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45244.log.gz 2024-04-16T12:58:38.226 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49062.log.gz 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44200.log 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44536.log.gz 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44200.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44200.log.gz 2024-04-16T12:58:38.227 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49782.log 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47823.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49782.log.gz 2024-04-16T12:58:38.228 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43871.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48143.log 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42983.log 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48143.log.gz 2024-04-16T12:58:38.229 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47183.log 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44866.log 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42983.log: /var/log/ceph/ceph-client.admin.47183.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44866.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42983.log.gz 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47183.log.gz 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48289.log 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44866.log.gz 2024-04-16T12:58:38.230 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.log: gzip/var/log/ceph/ceph-client.admin.48289.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.2.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48289.log.gz 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr: 84.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46542.log 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47529.log 2024-04-16T12:58:38.231 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46542.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gz 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46542.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43396.log 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47529.log: /var/log/ceph/ceph-client.admin.43396.log: 88.0% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43396.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47529.log.gz 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49698.log 2024-04-16T12:58:38.232 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45472.log: /var/log/ceph/ceph-client.admin.49272.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44201.log 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47865.log: /var/log/ceph/ceph-client.admin.49698.log: 88.5% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49698.log.gz 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47057.log 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44201.log: /var/log/ceph/ceph-client.admin.47057.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44201.log.gz 2024-04-16T12:58:38.233 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44541.log 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47057.log.gz 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37507.log 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46290.log: /var/log/ceph/ceph-client.admin.44541.log: 88.6% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44541.log.gz 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49950.log 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.37507.log: -- /var/log/ceph/ceph-client.admin.47571.log 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37507.log.gz 2024-04-16T12:58:38.234 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48415.log 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47571.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49950.log.gz 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47571.log.gz 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48415.log: /var/log/ceph/ceph-client.admin.47697.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48415.log.gz 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44532.log 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-16T12:58:38.235 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49518.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48852.log 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44532.log.gz 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49908.log 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46626.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48852.log.gz 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2024-04-16T12:58:38.236 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45328.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49908.log.gz 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47283.log 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43025.log 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42899.log: /var/log/ceph/ceph-client.admin.47283.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gz 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47283.log.gzgzip 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44204.log 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-16T12:58:38.237 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43025.log: /var/log/ceph/ceph-client.admin.44204.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43025.log.gz 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44992.log 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44204.log.gz 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44992.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49434.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49740.log 2024-04-16T12:58:38.238 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43870.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2024-04-16T12:58:38.239 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49740.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49740.log.gz 2024-04-16T12:58:38.239 INFO:teuthology.orchestra.run.smithi106.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-16T12:58:38.239 INFO:teuthology.orchestra.run.smithi106.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-16T12:58:38.239 INFO:teuthology.orchestra.run.smithi171.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-16T12:58:38.240 INFO:teuthology.orchestra.run.smithi171.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-16T12:58:38.240 INFO:teuthology.orchestra.run.smithi171.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-16T12:58:38.241 INFO:teuthology.orchestra.run.smithi106.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-16T12:58:38.244 INFO:teuthology.orchestra.run.smithi106.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-16T12:58:38.249 INFO:teuthology.orchestra.run.smithi106.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-16T12:58:38.263 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-16T12:58:38.274 INFO:teuthology.orchestra.run.smithi171.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-16T12:58:38.275 INFO:teuthology.orchestra.run.smithi171.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-16T12:58:38.276 INFO:teuthology.orchestra.run.smithi106.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-16T12:58:38.277 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-16T12:58:38.277 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m0.144s 2024-04-16T12:58:38.277 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m0.583s 2024-04-16T12:58:38.277 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.046s 2024-04-16T12:58:38.286 INFO:teuthology.orchestra.run.smithi106.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-16T12:58:38.288 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-16T12:58:38.288 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m0.188s 2024-04-16T12:58:38.288 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m0.706s 2024-04-16T12:58:38.288 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.138s 2024-04-16T12:58:38.288 INFO:tasks.ceph:Archiving logs... 2024-04-16T12:58:38.289 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/remote/smithi106/log 2024-04-16T12:58:38.290 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T12:58:38.572 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/remote/smithi171/log 2024-04-16T12:58:38.573 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T12:58:38.687 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T12:58:38.699 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T12:58:38.699 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T12:58:38.702 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T12:58:38.786 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T12:58:38.798 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T12:58:38.798 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:58:38.801 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:58:38.813 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:58:38.815 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:58:38.817 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:58:38.817 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-04-16T12:58:38.817 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +479us[ +503us] +/- 56ms 2024-04-16T12:58:38.817 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -737us[ -713us] +/- 62ms 2024-04-16T12:58:38.817 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +308us[ +332us] +/- 89ms 2024-04-16T12:58:38.817 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:58:38.818 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:58:38.818 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-04-16T12:58:38.819 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +475us[ +485us] +/- 56ms 2024-04-16T12:58:38.819 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -746us[ -737us] +/- 62ms 2024-04-16T12:58:38.819 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +304us[ +304us] +/- 89ms 2024-04-16T12:58:38.819 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:58:38.820 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T12:58:38.834 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T12:58:38.835 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T12:58:38.884 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T12:58:38.956 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T12:58:39.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:58:39.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:58:39.055 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:58:39.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:58:39.086 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T12:58:39.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T12:58:39.134 INFO:teuthology.task.internal:Duration was 583.591092 seconds 2024-04-16T12:58:39.135 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T12:58:39.184 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T12:58:39.185 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T12:58:39.187 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T12:58:39.231 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:58:39.232 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:58:39.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T12:58:39.546 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-04-16T12:58:39.547 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T12:58:39.567 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-04-16T12:58:39.568 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T12:58:39.591 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T12:58:39.591 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T12:58:39.610 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T12:58:39.661 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T12:58:39.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:58:39.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:58:39.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-16T12:58:39.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T12:58:39.809 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T12:58:39.809 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T12:58:39.838 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T12:58:39.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T12:58:39.878 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:58:39.880 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:58:39.905 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-04-16T12:58:39.934 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-04-16T12:58:39.960 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:58:39.980 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi106.front.sepia.ceph.com, flagging run as failed 2024-04-16T12:58:39.981 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:58:40.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:58:40.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T12:58:40.025 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T12:58:40.026 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/remote/smithi106 2024-04-16T12:58:40.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T12:58:48.129 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-16T12:58:48.143 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170/remote/smithi106/coredump/1713272279.48144.core.gz: gzip compressed data, was "1713272279.48144.core", last modified: Tue Apr 16 12:58:40 2024, max compression, original size modulo 2^32 267993088 2024-04-16T12:58:48.144 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-16T12:58:49.279 INFO:teuthology.task.internal: core looks like: /tmp/tmp8r4rjr5r: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-04-16T12:58:49.309 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i a 2024-04-16T12:58:49.309 DEBUG:teuthology.orchestra.run.smithi106:> which 'ceph-mds -f --cluster ceph -i a' 2024-04-16T12:58:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/which: invalid option -- 'f' 2024-04-16T12:58:49.331 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-04-16T12:58:49.331 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/which: no a in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-16T12:58:49.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:58:49.332 INFO:teuthology.orchestra.run.smithi106.stdout:/usr/bin/ceph-mds 2024-04-16T12:58:49.332 INFO:teuthology.orchestra.run.smithi106.stdout:/usr/bin/ceph 2024-04-16T12:58:49.332 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-16T12:58:49.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T12:58:49.358 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T12:58:49.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T12:58:49.398 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T12:58:49.399 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T12:58:49.405 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T12:58:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: 265537 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest 2024-04-16T12:58:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: 265561 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest/archive 2024-04-16T12:58:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: 265578 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:58:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: 265408 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:48 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T12:58:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: 265421 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:48 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T12:58:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: 265422 184 -rw-r--r-- 1 ubuntu ubuntu 187708 Apr 16 12:58 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:58:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: 395023 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest/archive/audit 2024-04-16T12:58:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: 395306 136 -rw------- 1 ubuntu ubuntu 137521 Apr 16 12:58 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T12:58:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: 265568 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:58:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: 265562 22424 -rw------- 1 root root 267993088 Apr 16 12:57 /home/ubuntu/cephtest/archive/coredump/1713272279.48144.core 2024-04-16T12:58:49.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:58:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T12:58:49.424 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-16T12:58:49.438 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T12:58:49.450 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T12:58:49.476 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi106 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-16T12:58:49.476 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T12:58:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest 2024-04-16T12:58:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: 262167 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest/archive 2024-04-16T12:58:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:58:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: 265397 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:48 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T12:58:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: 265306 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:48 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T12:58:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: 265305 180 -rw-r--r-- 1 ubuntu ubuntu 183333 Apr 16 12:58 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:58:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: 265396 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:58 /home/ubuntu/cephtest/archive/audit 2024-04-16T12:58:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: 265414 116 -rw------- 1 ubuntu ubuntu 117439 Apr 16 12:58 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T12:58:49.488 INFO:teuthology.orchestra.run.smithi171.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T12:58:49.513 DEBUG:teuthology.nuke:shortname: smithi106 2024-04-16T12:58:49.514 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T12:58:49.537 DEBUG:teuthology.nuke:shortname: smithi171 2024-04-16T12:58:49.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T12:58:49.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:39:07.145101', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfAhReQBkvDER85Qt8aPzMXLGHjz5ewbRsrgVCMdqGCKXPmfvCoH3A5k9Wpy0MNCelYiVuB+XmYpqfk3E+lcB0='} 2024-04-16T12:58:49.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658170', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:39:07.143422', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPeCb8gfBXs8Y0kYyAno9Q+hoxzxmPb9dQLiTUnzBrSbC7gAX/hjVH8GhxcYhAd1wyVry9JJ28gkaqgFNCc2gj0='} 2024-04-16T12:58:49.592 INFO:teuthology.orchestra.console.smithi106:Power off 2024-04-16T12:58:49.592 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T12:58:49.615 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-04-16T12:58:49.616 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:58:49.632 INFO:teuthology.orchestra.console.smithi171:Power off 2024-04-16T12:58:49.632 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T12:58:49.642 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-16T12:58:49.657 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-04-16T12:58:49.657 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:58:49.681 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-16T12:58:53.644 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:58:53.682 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:58:53.755 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-16T12:58:53.791 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-16T12:58:57.758 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:58:57.792 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:58:57.869 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-16T12:58:57.903 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-04-16T12:58:58.003 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-04-16T12:59:01.873 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:59:01.984 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-16T12:59:02.085 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-04-16T12:59:02.191 INFO:teuthology.run:Summary data: description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/centos_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} duration: 583.5910918712616 failure_reason: 'Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=312ea8964fdc4f59ae28dfc9115adda9 status: fail success: false 2024-04-16T12:59:02.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T12:59:02.283 INFO:teuthology.run:FAIL